Feb 27 01:56:27 devstack cinder-volume[73290]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 01:56:27 devstack cinder-volume[73290]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 01:56:27 devstack cinder-volume[73290]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 01:56:28 devstack cinder-volume[73290]: INFO dbcounter [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Registered counter for database cinder
Feb 27 01:56:28 devstack cinder-volume[73290]: DEBUG oslo_db.sqlalchemy.engines [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:56:28 devstack cinder-volume[73290]: DEBUG dbcounter [-] [73290] Writer thread running {{(pid=73290) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:56:28 devstack cinder-volume[73290]: INFO cinder.rpc [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 27 01:56:28 devstack cinder-volume[73290]: INFO cinder.rpc [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 27 01:56:28 devstack cinder-volume[73290]: DEBUG oslo_db.sqlalchemy.engines [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:56:28 devstack cinder-volume[73290]: INFO cinder.volume.manager [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Determined volume DB was empty at startup.
Feb 27 01:56:28 devstack cinder-volume[73290]: DEBUG cinder.volume.manager [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73290) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 27 01:56:28 devstack cinder-volume[73290]: INFO cinder.volume.manager [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 27 01:56:28 devstack cinder-volume[73290]: WARNING stevedore.named [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:56:28 devstack cinder-volume[73290]: WARNING castellan.key_manager [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:56:28 devstack cinder-volume[73290]: WARNING cinder.keymgr.conf_key_mgr [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:56:28 devstack cinder-volume[73290]: DEBUG cinder.volume.drivers.lvm [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73290) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Feb 27 01:56:28 devstack cinder-volume[73290]: DEBUG oslo_concurrency.processutils [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73290) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:28 devstack cinder-volume[73290]: DEBUG oslo_concurrency.processutils [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] CMD "cinder-rtstool verify" returned: 0 in 0.275s {{(pid=73290) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:28 devstack cinder-volume[73290]: DEBUG oslo_db.sqlalchemy.engines [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:56:29 devstack cinder-volume[73290]: INFO cinder.rpc [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Feb 27 01:56:29 devstack cinder-volume[73290]: INFO cinder.rpc [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Feb 27 01:56:29 devstack cinder-volume[73290]: WARNING stevedore.named [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 01:56:29 devstack cinder-volume[73290]: WARNING castellan.key_manager [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 01:56:29 devstack cinder-volume[73290]: INFO cinder.volume.manager [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_db.sqlalchemy.engines [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:56:29 devstack cinder-volume[73290]: INFO oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Starting 1 workers
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Started child 73397 {{(pid=73290) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Full set of CONF: {{(pid=73290) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] ******************************************************************************** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Configuration options gathered from: {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] ================================================================================ {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] allow_availability_zone_fallback = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] allow_compression_on_image_upload = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] allowed_direct_url_schemes     = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] api_rate_limit                 = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] auth_strategy                  = keystone {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] az_cache_duration              = 3600 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_availability_zone      = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_host                   = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_name                   = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_stats_polling_interval = 60 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backup_api_class               = cinder.backup.api.API {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backup_name_template           = backup-%s {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backup_use_same_host           = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backup_use_temp_snapshot       = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] chap_password                  = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] chap_username                  =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cinder_internal_tenant_project_id = 7f9b7e1935314cee91fb56958d73a79c {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cinder_internal_tenant_user_id = 5fa56760f3ed44a0badb9c64e123ee67 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cloned_volume_same_az          = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cluster                        = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] compression_format             = gzip {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] compute_api_class              = cinder.compute.nova.API {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] config_dir                     = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] config_source                  = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] control_exchange               = openstack {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] debug                          = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] default_availability_zone      = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] default_group_type             = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73397]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] default_volume_type            = lvmdriver-1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] disk_geometry                  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] driver_client_cert             = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] driver_client_cert_key         = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] driver_data_namespace          = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] driver_ssl_cert_path           = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] driver_ssl_cert_verify         = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] driver_use_ssl                 = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] enable_force_upload            = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] enable_new_services            = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] enable_unsupported_driver      = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] enforce_multipath_for_image_xfer = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] filter_function                = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_api_insecure            = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_api_servers             = ['http://192.168.122.18/image'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_api_ssl_compression     = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_ca_certificates_file    = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_catalog_info            = image:glance:publicURL {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_certfile                = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_keyfile                 = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_num_retries             = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance_request_timeout         = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] goodness_function              = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] graceful_shutdown_timeout      = 5 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] group_api_class                = cinder.group.api.API {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] host                           = devstack {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_compress_on_upload       = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_conversion_address_space_limit = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_conversion_cpu_limit     = 60 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_conversion_disable       = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_upload_use_cinder_backend = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_upload_use_internal_tenant = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_volume_cache_enabled     = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_volume_cache_max_count   = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] image_volume_cache_max_size_gb = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] init_host_max_objects_retrieval = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] iscsi_target_flags             =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] iscsi_write_cache              = on {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] iser_helper                    = tgtadm {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] iser_ip_address                = 192.168.122.18 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] iser_port                      = 3260 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] log_color                      = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] log_config_append              = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] log_dir                        = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] log_file                       = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] log_options                    = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] log_rotate_interval            = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] log_rotate_interval_type       = days {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] log_rotation_type              = none {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] max_age                        = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] max_logfile_count              = 30 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] max_logfile_size_mb            = 200 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] max_over_subscription_ratio    = 20.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] message_reap_interval          = 86400 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] message_ttl                    = 2592000 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] migration_create_volume_timeout_secs = 300 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] monkey_patch                   = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] monkey_patch_modules           = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] my_ip                          = 192.168.122.18 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] no_snapshot_gb_quota           = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] num_iser_scan_tries            = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] num_shell_tries                = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] num_volume_device_scan_tries   = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] nvmeof_conn_info_version       = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] nvmet_ns_id                    = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] nvmet_port_id                  = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] osapi_max_limit                = 1000 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] osapi_volume_ext_list          = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] osapi_volume_listen_port       = 8776 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] osapi_volume_use_ssl           = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] osapi_volume_workers           = 2 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] per_volume_size_limit          = -1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] periodic_fuzzy_delay           = 60 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] periodic_interval              = 60 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] public_endpoint                = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] publish_errors                 = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] quota_backup_gigabytes         = 1000 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] quota_backups                  = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] quota_gigabytes                = 1000 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] quota_groups                   = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] quota_snapshots                = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] quota_volumes                  = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] rate_limit_burst               = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] rate_limit_except_level        = CRITICAL {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] rate_limit_interval            = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] reinit_driver_count            = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] replication_device             = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] report_discard_supported       = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] report_interval                = 120 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] reservation_clean_interval     = 86400 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] reservation_expire             = 86400 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] reserved_image_namespaces      = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] reserved_percentage            = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] rpc_response_timeout           = 120 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] run_external_periodic_tasks    = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] scst_target_driver             = iscsi {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] scst_target_iqn_name           = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_down_time              = 720 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] shell_completion               = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] snapshot_name_template         = snapshot-%s {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] snapshot_same_host             = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] split_loggers                  = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] state_path                     = /opt/stack/data/cinder {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] storage_availability_zone      = nova {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] storage_protocol               = iSCSI {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] syslog_log_facility            = LOG_USER {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] target_helper                  = lioadm {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] target_ip_address              = 192.168.122.18 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] target_port                    = 3260 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] target_protocol                = iscsi {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] target_secondary_ip_addresses  = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] trace_flags                    = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] transport_url                  = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] until_refresh                  = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] use_chap_auth                  = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] use_default_quota_class        = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] use_journal                    = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] use_json                       = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] use_multipath_for_image_xfer   = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] use_stderr                     = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] use_syslog                     = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] verify_glance_signatures       = enabled {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_api_class               = cinder.volume.api.API {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_backend_name            = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_clear                   = zero {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_clear_ionice            = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_clear_size              = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_copy_bps_limit          = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_dd_blocksize            = 1M {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_name_template           = volume-%s {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_service_inithost_offload = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volume_usage_audit_period      = month {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] zoning_mode                    = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_concurrency.disable_process_locking = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.admin_password = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.admin_token = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.admin_user  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.auth_port   = 35357 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.auth_protocol = https {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.auth_section = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.auth_type   = password {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.auth_uri    = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.auth_version = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.cache       = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.certfile    = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.identity_uri = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.include_service_catalog = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.insecure    = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.interface   = public {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.keyfile     = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_password =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcache_username =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.region_name = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.service_type = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.18/identity {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.backend                  = dogpile.cache.null {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.backend_argument         = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.backend_expiration_time  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.config_prefix            = cache.oslo {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.debug_cache_backend      = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.enable_retry_client      = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.enable_socket_keepalive  = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.enabled                  = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.enforce_fips_mode        = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.expiration_time          = 600 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.hashclient_retry_attempts = 2 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.memcache_dead_retry      = 300 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.memcache_sasl_enabled    = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.password                 = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.proxies                  = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.redis_db                 = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.redis_server             = localhost:6379 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.retry_attempts           = 2 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.retry_delay              = 0.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.socket_keepalive_count   = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.socket_keepalive_idle    = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.socket_keepalive_interval = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.socket_timeout           = 1.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.tls_allowed_ciphers      = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.tls_cafile               = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.tls_certfile             = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.tls_enabled              = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.tls_keyfile              = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cache.username                 = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] coordination.backend_url       = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.asyncio_connection    = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.asyncio_slave_connection = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.backend               = sqlalchemy {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.connection            = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.connection_debug      = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.connection_parameters =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.connection_recycle_time = 3600 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.connection_trace      = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.db_inc_retry_interval = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.db_max_retries        = 20 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.db_max_retry_interval = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.db_retry_interval     = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.max_overflow          = 50 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.max_pool_size         = 5 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.max_retries           = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.mysql_wsrep_sync_wait = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.pool_timeout          = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.retry_interval        = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.slave_connection      = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.sqlite_synchronous    = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.synchronous_reader    = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] database.use_db_reconnect      = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.connection_string     = messaging:// {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.enabled               = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.es_doc_type           = notification {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.es_scroll_size        = 10000 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.es_scroll_time        = 2m {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.filter_error_trace    = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.hmac_keys             = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.sentinel_service_name = mymaster {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.socket_timeout        = 0.1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.trace_requests        = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler.trace_sqlalchemy      = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler_jaeger.process_tags   = {} {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler_jaeger.service_name_prefix = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] profiler_otlp.service_name_prefix = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.enforce_new_defaults = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: WARNING oslo_config.cfg [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.enforce_scope      = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.policy_default_rule = default {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] privsep_osbrick.group          = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] privsep_osbrick.helper_command = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] privsep_osbrick.user           = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cinder_sys_admin.group         = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cinder_sys_admin.helper_command = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] cinder_sys_admin.user          = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.auth_section      = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.auth_type         = password {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.cafile            = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.certfile          = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.collect_timing    = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.insecure          = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.keyfile           = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.send_service_user_token = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.split_loggers     = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] service_user.timeout           = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.auth_section            = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.auth_type               = password {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.certfile                = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.collect_timing          = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.insecure                = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.keyfile                 = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.region_name             = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.split_loggers           = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] glance.timeout                 = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.backend_availability_zone = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.chap_password = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73397]: INFO cinder.volume.manager [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Feb 27 01:56:29 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.chap_username =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.disk_geometry = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.driver_client_cert = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.driver_client_cert_key = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.driver_data_namespace = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.driver_use_ssl = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.extra_capabilities = {} {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.filter_function = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.goodness_function = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.iscsi_target_flags =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.iscsi_write_cache = on {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.iser_helper   = tgtadm {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.iser_ip_address = 192.168.122.18 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.iser_port     = 3260 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.lvm_share_target = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.lvm_type      = auto {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.num_shell_tries = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.replication_device = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.report_discard_supported = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.reserved_percentage = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.target_helper = tgtadm {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.target_ip_address = 192.168.122.18 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.target_port   = 3260 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.target_protocol = iscsi {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.trace_flags   = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.unique_fqdn_network = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.use_chap_auth = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volume_backend_name = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volume_clear  = zero {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volume_clear_ionice = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volume_clear_size = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_reports.file_event_handler = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_reports.log_dir           = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.backend_host       = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.chap_password      = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.chap_username      = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.disk_geometry      = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.driver_client_cert = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.extra_capabilities = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.filter_function    = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.goodness_function  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.iser_helper        = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.iser_ip_address    = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.iser_port          = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.lvm_share_target   = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.lvm_type           = auto {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.num_shell_tries    = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.replication_device = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.report_discard_supported = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.reserved_percentage = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.scst_target_driver = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.storage_protocol   = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.target_helper      = lioadm {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.target_ip_address  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.target_port        = 3260 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.trace_flags        = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.use_chap_auth      = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volume_clear       = zero {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volume_clear_size  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] lvmdriver-1.volumes_dir        = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:29 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_notifications.driver = [] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_notifications.retry = -1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] key_manager.fixed_key          = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.barbican_api_version  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.barbican_endpoint     = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.barbican_endpoint_type = public {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.barbican_region_name  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.cafile                = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.certfile              = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.collect_timing        = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.insecure              = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.keyfile               = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.number_of_retries     = 60 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.retry_delay           = 1 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.send_service_user_token = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.split_loggers         = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.timeout               = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.verify_ssl            = True {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican.verify_ssl_path       = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican_service_user.auth_section = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican_service_user.auth_type = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican_service_user.cafile   = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican_service_user.certfile = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican_service_user.collect_timing = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican_service_user.insecure = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican_service_user.keyfile  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican_service_user.split_loggers = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] barbican_service_user.timeout  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.approle_role_id          = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.approle_secret_id        = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.kv_mountpoint            = secret {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack sudo[73451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Feb 27 01:56:29 devstack sudo[73451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.kv_path                  = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.kv_version               = 2 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.namespace                = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.root_token_id            = **** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.ssl_ca_crt_file          = None {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.timeout                  = 60.0 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.use_ssl                  = False {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 01:56:29 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] ******************************************************************************** {{(pid=73290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 27 01:56:29 devstack sudo[73451]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:29 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:29 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:29 devstack sudo[73695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:56:29 devstack sudo[73695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:30 devstack sudo[73695]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:30 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.486s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:30 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 01:56:30 devstack cinder-volume[73397]: INFO cinder.brick.local_dev.lvm [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Feb 27 01:56:30 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:30 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:30 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:30 devstack sudo[73878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:56:30 devstack sudo[73878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:30 devstack sudo[73878]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:30 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:30 devstack cinder-volume[73397]: DEBUG cinder.brick.local_dev.lvm [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73397) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Feb 27 01:56:30 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:30 devstack sudo[73944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:56:30 devstack sudo[73944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:31 devstack sudo[73944]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:31 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.728s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:31 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:31 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:31 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:31 devstack sudo[74076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:56:31 devstack sudo[74076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:32 devstack sudo[74076]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:32 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.428s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:32 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:32 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:32 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:32 devstack sudo[74080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Feb 27 01:56:32 devstack sudo[74080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:32 devstack sudo[74080]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:32 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.571s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:32 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:32 devstack sudo[74084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:56:32 devstack sudo[74084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:33 devstack sudo[74084]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:33 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:33 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:33 devstack sudo[74092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:56:33 devstack sudo[74092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:33 devstack sudo[74092]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:33 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:33 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:33 devstack sudo[74095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:56:33 devstack sudo[74095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:34 devstack sudo[74095]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:34 devstack sudo[74101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:56:34 devstack sudo[74101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:34 devstack sudo[74101]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:34 devstack sudo[74105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:56:34 devstack sudo[74105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:34 devstack sudo[74105]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:34 devstack cinder-volume[73397]: INFO cinder.volume.drivers.lvm [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:34 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:34 devstack sudo[74115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:56:34 devstack sudo[74115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:35 devstack sudo[74115]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:35 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:35 devstack cinder-volume[73397]: DEBUG cinder.volume.drivers.lvm [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Updating volume stats {{(pid=73397) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:56:35 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:35 devstack sudo[74229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:56:35 devstack sudo[74229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:35 devstack sudo[74229]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:35 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:35 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:35 devstack sudo[74367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:56:35 devstack sudo[74367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:36 devstack sudo[74367]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:36 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:36 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:36 devstack sudo[74404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:56:36 devstack sudo[74404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:36 devstack sudo[74404]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:36 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:36 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:36 devstack sudo[74410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:56:36 devstack sudo[74410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:37 devstack sudo[74410]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:37 devstack cinder-volume[73397]: INFO cinder.volume.driver [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Driver hasn't implemented _init_vendor_properties()
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG cinder.volume.driver [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73397) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG oslo_db.sqlalchemy.engines [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG dbcounter [-] [73397] Writer thread running {{(pid=73397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG cinder.db.sqlalchemy.api [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Building query based on filter {{(pid=73397) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG cinder.image.image_utils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73397) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 27 01:56:37 devstack cinder-volume[73397]: INFO cinder.keymgr.migration [None req-c21d7253-2386-4522-b964-70447adc9caf None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG cinder.volume.drivers.lvm [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Updating volume stats {{(pid=73397) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:37 devstack sudo[74417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:56:37 devstack sudo[74417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:37 devstack sudo[74417]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:37 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:37 devstack sudo[74420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:56:37 devstack sudo[74420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:38 devstack sudo[74420]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:38 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:38 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:38 devstack sudo[74425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:56:38 devstack sudo[74425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:38 devstack sudo[74425]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:38 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:38 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:38 devstack sudo[74432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:56:38 devstack sudo[74432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:39 devstack cinder-volume[73290]: DEBUG dbcounter [-] [73290] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73290) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:56:39 devstack sudo[74432]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:39 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:39 devstack cinder-volume[73397]: DEBUG cinder.manager [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Notifying Schedulers of capabilities ... {{(pid=73397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:56:39 devstack cinder-volume[73397]: INFO cinder.volume.manager [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Driver initialization completed successfully.
Feb 27 01:56:39 devstack cinder-volume[73397]: INFO cinder.manager [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Initiating service 2 cleanup
Feb 27 01:56:39 devstack cinder-volume[73397]: INFO cinder.manager [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Service 2 cleanup completed.
Feb 27 01:56:39 devstack cinder-volume[73397]: DEBUG cinder.service [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Creating RPC server for service cinder-volume {{(pid=73397) start /opt/stack/cinder/cinder/service.py:231}}
Feb 27 01:56:39 devstack cinder-volume[73397]: DEBUG cinder.service [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73397) start /opt/stack/cinder/cinder/service.py:237}}
Feb 27 01:56:39 devstack cinder-volume[73397]: INFO cinder.volume.manager [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Feb 27 01:56:39 devstack cinder-volume[73397]: DEBUG cinder.volume.drivers.lvm [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Updating volume stats {{(pid=73397) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:56:39 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:39 devstack sudo[74437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:56:39 devstack sudo[74437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:39 devstack sudo[74437]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:39 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:39 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:39 devstack sudo[74494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:56:39 devstack sudo[74494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:40 devstack sudo[74494]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:40 devstack sudo[74497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:56:40 devstack sudo[74497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:40 devstack sudo[74497]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.425s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:56:40 devstack sudo[74620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:56:40 devstack sudo[74620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:56:40 devstack sudo[74620]: pam_unix(sudo:session): session closed for user root
Feb 27 01:56:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.413s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:56:41 devstack cinder-volume[73397]: INFO cinder.volume.manager [None req-63f3d2fe-d2ce-4413-8f12-c936f798efa6 None None] Driver post RPC initialization completed successfully.
Feb 27 01:56:50 devstack cinder-volume[73397]: DEBUG dbcounter [-] [73397] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:56:50 devstack cinder-volume[73397]: DEBUG dbcounter [-] [73397] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:57:40 devstack cinder-volume[73397]: DEBUG oslo_service.periodic_task [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:57:40 devstack cinder-volume[73397]: DEBUG cinder.volume.drivers.lvm [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Updating volume stats {{(pid=73397) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:57:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:57:40 devstack sudo[77019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:57:40 devstack sudo[77019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:57:40 devstack sudo[77019]: pam_unix(sudo:session): session closed for user root
Feb 27 01:57:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:57:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:57:40 devstack sudo[77384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:57:40 devstack sudo[77384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:57:40 devstack sudo[77384]: pam_unix(sudo:session): session closed for user root
Feb 27 01:57:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:57:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:57:40 devstack sudo[77799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:57:40 devstack sudo[77799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:57:41 devstack sudo[77799]: pam_unix(sudo:session): session closed for user root
Feb 27 01:57:41 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:57:41 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:57:41 devstack sudo[78310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:57:41 devstack sudo[78310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:57:41 devstack sudo[78310]: pam_unix(sudo:session): session closed for user root
Feb 27 01:57:41 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:57:41 devstack cinder-volume[73397]: DEBUG cinder.manager [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Notifying Schedulers of capabilities ... {{(pid=73397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:58:40 devstack cinder-volume[73397]: DEBUG oslo_service.periodic_task [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:58:40 devstack cinder-volume[73397]: DEBUG cinder.volume.drivers.lvm [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Updating volume stats {{(pid=73397) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:58:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:58:40 devstack sudo[80016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:58:40 devstack sudo[80016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:58:40 devstack sudo[80016]: pam_unix(sudo:session): session closed for user root
Feb 27 01:58:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:58:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:58:40 devstack sudo[80044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:58:40 devstack sudo[80044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:58:40 devstack sudo[80044]: pam_unix(sudo:session): session closed for user root
Feb 27 01:58:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:58:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:58:40 devstack sudo[80092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:58:40 devstack sudo[80092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:58:41 devstack sudo[80092]: pam_unix(sudo:session): session closed for user root
Feb 27 01:58:41 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:58:41 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:58:41 devstack sudo[80294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:58:41 devstack sudo[80294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:58:41 devstack sudo[80294]: pam_unix(sudo:session): session closed for user root
Feb 27 01:58:41 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:58:41 devstack cinder-volume[73397]: DEBUG cinder.manager [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Notifying Schedulers of capabilities ... {{(pid=73397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 01:58:51 devstack cinder-volume[73397]: DEBUG dbcounter [-] [73397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73397) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 01:59:40 devstack cinder-volume[73397]: DEBUG oslo_service.periodic_task [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73397) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 01:59:40 devstack cinder-volume[73397]: DEBUG cinder.volume.drivers.lvm [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Updating volume stats {{(pid=73397) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Feb 27 01:59:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:59:40 devstack sudo[81900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Feb 27 01:59:40 devstack sudo[81900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:59:40 devstack sudo[81900]: pam_unix(sudo:session): session closed for user root
Feb 27 01:59:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:59:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:59:40 devstack sudo[81906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:59:40 devstack sudo[81906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:59:40 devstack sudo[81906]: pam_unix(sudo:session): session closed for user root
Feb 27 01:59:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:59:40 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:59:40 devstack sudo[81915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Feb 27 01:59:40 devstack sudo[81915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:59:41 devstack sudo[81915]: pam_unix(sudo:session): session closed for user root
Feb 27 01:59:41 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.419s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:59:41 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 01:59:41 devstack sudo[81918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Feb 27 01:59:41 devstack sudo[81918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 01:59:41 devstack sudo[81918]: pam_unix(sudo:session): session closed for user root
Feb 27 01:59:41 devstack cinder-volume[73397]: DEBUG oslo_concurrency.processutils [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73397) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 01:59:41 devstack cinder-volume[73397]: DEBUG cinder.manager [None req-51a64fb8-9cf4-405f-8956-c8ef2ce7b121 None None] Notifying Schedulers of capabilities ... {{(pid=73397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:00:07 devstack cinder-volume[73290]: INFO oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Caught SIGTERM, stopping children
Feb 27 02:00:07 devstack cinder-volume[73290]: DEBUG oslo_concurrency.lockutils [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Acquiring lock "singleton_lock" {{(pid=73290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 02:00:07 devstack cinder-volume[73290]: DEBUG oslo_concurrency.lockutils [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Acquired lock "singleton_lock" {{(pid=73290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 02:00:07 devstack cinder-volume[73290]: DEBUG oslo_concurrency.lockutils [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Releasing lock "singleton_lock" {{(pid=73290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 02:00:07 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Stop services. {{(pid=73290) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 27 02:00:07 devstack cinder-volume[73290]: DEBUG oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Killing children. {{(pid=73290) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 27 02:00:07 devstack cinder-volume[73290]: INFO oslo_service.backend._eventlet.service [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Waiting on 1 children to exit
Feb 27 02:00:12 devstack cinder-volume[73397]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Feb 27 02:00:14 devstack cinder-volume[73397]: DEBUG oslo_concurrency.lockutils [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Acquiring lock "singleton_lock" {{(pid=73397) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 02:00:14 devstack cinder-volume[73397]: DEBUG oslo_concurrency.lockutils [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Acquired lock "singleton_lock" {{(pid=73397) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 02:00:14 devstack cinder-volume[73397]: DEBUG oslo_concurrency.lockutils [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Releasing lock "singleton_lock" {{(pid=73397) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 02:00:14 devstack cinder-volume[73397]: WARNING amqp [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 02:00:14 devstack cinder-volume[73397]: WARNING amqp [None req-0bb0df1d-7cfd-4ed3-92ca-ee118b9f7699 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 02:00:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 02:00:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 02:00:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 02:00:14 devstack cinder-volume[82604]: INFO dbcounter [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Registered counter for database cinder
Feb 27 02:00:14 devstack cinder-volume[82604]: DEBUG oslo_db.sqlalchemy.engines [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writer thread running {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 02:00:15 devstack cinder-volume[82604]: INFO cinder.rpc [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 27 02:00:15 devstack cinder-volume[82604]: INFO cinder.rpc [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_db.sqlalchemy.engines [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 02:00:15 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Determined volume DB was empty at startup.
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82604) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 27 02:00:15 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Service not found for updating active_backend_id, assuming default for driver init.
Feb 27 02:00:15 devstack cinder-volume[82604]: WARNING stevedore.named [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 02:00:15 devstack cinder-volume[82604]: WARNING castellan.key_manager [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 02:00:15 devstack cinder-volume[82604]: WARNING cinder.keymgr.conf_key_mgr [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 02:00:15 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_db.sqlalchemy.engines [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 02:00:15 devstack cinder-volume[82604]: INFO oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Starting 1 workers
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Started child 82719 {{(pid=82604) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Full set of CONF: {{(pid=82604) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] ******************************************************************************** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Configuration options gathered from: {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] ================================================================================ {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] allow_availability_zone_fallback = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] allow_compression_on_image_upload = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] allowed_direct_url_schemes     = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] api_rate_limit                 = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] auth_strategy                  = keystone {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_availability_zone      = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_host                   = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_name                   = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_stats_polling_interval = 60 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backup_api_class               = cinder.backup.api.API {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backup_name_template           = backup-%s {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backup_use_same_host           = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backup_use_temp_snapshot       = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] chap_password                  = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] chap_username                  =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cinder_internal_tenant_project_id = 7f9b7e1935314cee91fb56958d73a79c {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cinder_internal_tenant_user_id = 5fa56760f3ed44a0badb9c64e123ee67 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cluster                        = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] compression_format             = gzip {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] config_dir                     = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] config_source                  = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] control_exchange               = openstack {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] debug                          = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] default_availability_zone      = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] default_group_type             = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] default_volume_type            = QuobyteHD {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] disk_geometry                  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] driver_client_cert             = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] driver_client_cert_key         = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] driver_data_namespace          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] driver_ssl_cert_path           = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] driver_ssl_cert_verify         = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] driver_use_ssl                 = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] enable_new_services            = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] enable_unsupported_driver      = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] enforce_multipath_for_image_xfer = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] filter_function                = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_api_insecure            = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_api_servers             = ['http://192.168.122.18/image'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_api_ssl_compression     = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_ca_certificates_file    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_certfile                = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_keyfile                 = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_num_retries             = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance_request_timeout         = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] goodness_function              = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] graceful_shutdown_timeout      = 5 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] group_api_class                = cinder.group.api.API {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] host                           = devstack {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_compress_on_upload       = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_conversion_address_space_limit = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82719]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_conversion_cpu_limit     = 60 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_conversion_disable       = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_upload_use_cinder_backend = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_upload_use_internal_tenant = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_volume_cache_enabled     = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_volume_cache_max_count   = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] image_volume_cache_max_size_gb = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] init_host_max_objects_retrieval = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] iscsi_target_flags             =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] iscsi_write_cache              = on {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] iser_helper                    = tgtadm {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] iser_ip_address                = 192.168.122.18 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] iser_port                      = 3260 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] log_color                      = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] log_config_append              = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] log_dir                        = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] log_file                       = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] log_options                    = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] log_rotate_interval            = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] log_rotate_interval_type       = days {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] log_rotation_type              = none {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] max_age                        = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] max_logfile_count              = 30 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] max_logfile_size_mb            = 200 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] max_over_subscription_ratio    = 20.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] message_reap_interval          = 86400 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] message_ttl                    = 2592000 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] migration_create_volume_timeout_secs = 300 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] monkey_patch                   = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] monkey_patch_modules           = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] my_ip                          = 192.168.122.18 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] no_snapshot_gb_quota           = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] num_iser_scan_tries            = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] num_shell_tries                = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] num_volume_device_scan_tries   = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] nvmeof_conn_info_version       = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] nvmet_ns_id                    = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82719]: INFO cinder.volume.manager [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.remotefs [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82719) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] nvmet_port_id                  = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] osapi_max_limit                = 1000 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] osapi_volume_ext_list          = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] osapi_volume_listen_port       = 8776 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] osapi_volume_use_ssl           = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] osapi_volume_workers           = 2 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] per_volume_size_limit          = -1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] periodic_fuzzy_delay           = 60 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] periodic_interval              = 60 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] public_endpoint                = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] publish_errors                 = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] quota_backup_gigabytes         = 1000 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] quota_backups                  = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] quota_gigabytes                = 1000 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] quota_groups                   = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] quota_snapshots                = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] quota_volumes                  = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] rate_limit_burst               = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] rate_limit_except_level        = CRITICAL {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] rate_limit_interval            = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] reinit_driver_count            = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] replication_device             = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] report_discard_supported       = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] report_interval                = 120 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] reservation_clean_interval     = 86400 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] reservation_expire             = 86400 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] reserved_image_namespaces      = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] reserved_percentage            = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] rpc_response_timeout           = 120 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] run_external_periodic_tasks    = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] scst_target_driver             = iscsi {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] scst_target_iqn_name           = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_down_time              = 720 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] shell_completion               = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] snapshot_name_template         = snapshot-%s {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] split_loggers                  = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] state_path                     = /opt/stack/data/cinder {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] storage_availability_zone      = nova {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] storage_protocol               = iSCSI {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] syslog_log_facility            = LOG_USER {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] target_helper                  = lioadm {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] target_ip_address              = 192.168.122.18 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] target_port                    = 3260 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] target_protocol                = iscsi {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] target_secondary_ip_addresses  = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] trace_flags                    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] transport_url                  = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] until_refresh                  = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] use_chap_auth                  = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] use_default_quota_class        = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] use_journal                    = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] use_json                       = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] use_multipath_for_image_xfer   = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] use_stderr                     = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] use_syslog                     = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] verify_glance_signatures       = enabled {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_api_class               = cinder.volume.api.API {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_backend_name            = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_clear                   = zero {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_clear_ionice            = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_clear_size              = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_copy_bps_limit          = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_dd_blocksize            = 1M {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_name_template           = volume-%s {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_service_inithost_offload = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volume_usage_audit_period      = month {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] zoning_mode                    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_concurrency.disable_process_locking = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.admin_password = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.admin_token = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.admin_user  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.auth_protocol = https {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.auth_section = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.auth_type   = password {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.auth_uri    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.auth_version = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.cache       = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.certfile    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.identity_uri = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.include_service_catalog = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.insecure    = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.interface   = public {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.keyfile     = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_password =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcache_username =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.region_name = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.service_type = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.18/identity {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.backend                  = dogpile.cache.null {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.backend_argument         = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.backend_expiration_time  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.config_prefix            = cache.oslo {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.debug_cache_backend      = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.enable_retry_client      = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.enable_socket_keepalive  = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.enabled                  = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.enforce_fips_mode        = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.expiration_time          = 600 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.hashclient_retry_attempts = 2 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.memcache_dead_retry      = 300 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.memcache_sasl_enabled    = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.password                 = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.proxies                  = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.redis_db                 = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.redis_server             = localhost:6379 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.retry_attempts           = 2 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.retry_delay              = 0.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.socket_keepalive_count   = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.socket_keepalive_idle    = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.socket_keepalive_interval = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.socket_timeout           = 1.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.tls_allowed_ciphers      = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.tls_cafile               = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.tls_certfile             = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.tls_enabled              = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.tls_keyfile              = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cache.username                 = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] coordination.backend_url       = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.asyncio_connection    = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.asyncio_slave_connection = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.backend               = sqlalchemy {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.connection            = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.connection_debug      = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.connection_parameters =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.connection_recycle_time = 3600 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.connection_trace      = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.db_inc_retry_interval = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.db_max_retries        = 20 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.db_max_retry_interval = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.db_retry_interval     = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.max_overflow          = 50 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.max_pool_size         = 5 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.max_retries           = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82719) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 27 02:00:15 devstack cinder-volume[82719]: WARNING cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 27 02:00:15 devstack cinder-volume[82719]: WARNING cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Running cmd (subprocess): mount.quobyte {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.mysql_wsrep_sync_wait = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.pool_timeout          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.retry_interval        = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.slave_connection      = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.sqlite_synchronous    = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.synchronous_reader    = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] database.use_db_reconnect      = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.connection_string     = messaging:// {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.enabled               = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.es_doc_type           = notification {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.es_scroll_size        = 10000 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.es_scroll_time        = 2m {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.filter_error_trace    = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.hmac_keys             = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.sentinel_service_name = mymaster {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.socket_timeout        = 0.1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.trace_requests        = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler.trace_sqlalchemy      = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler_jaeger.process_tags   = {} {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler_jaeger.service_name_prefix = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] profiler_otlp.service_name_prefix = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.enforce_new_defaults = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: WARNING oslo_config.cfg [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.enforce_scope      = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.policy_default_rule = default {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] privsep_osbrick.group          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] privsep_osbrick.helper_command = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] privsep_osbrick.user           = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cinder_sys_admin.group         = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cinder_sys_admin.helper_command = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] cinder_sys_admin.user          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.auth_section      = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.auth_type         = password {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.cafile            = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.certfile          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.collect_timing    = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.insecure          = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.keyfile           = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.send_service_user_token = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.split_loggers     = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] service_user.timeout           = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.auth_section            = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.auth_type               = password {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.certfile                = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.collect_timing          = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.insecure                = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.keyfile                 = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.region_name             = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.split_loggers           = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] glance.timeout                 = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.backend_availability_zone = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.chap_password = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.chap_username =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.disk_geometry = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.driver_client_cert = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.driver_client_cert_key = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.driver_data_namespace = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.driver_use_ssl = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.extra_capabilities = {} {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.filter_function = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.goodness_function = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.iscsi_target_flags =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.iscsi_write_cache = on {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.iser_ip_address = 192.168.122.18 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.iser_port     = 3260 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_host      =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_login     = admin {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_mount_options = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_password  = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_private_key =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_share_path =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.num_shell_tries = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.quobyte_volume_url = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.replication_device = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.report_discard_supported = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.reserved_percentage = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.target_helper = tgtadm {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.target_ip_address = 192.168.122.18 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.target_port   = 3260 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.target_protocol = iscsi {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.trace_flags   = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.unique_fqdn_network = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.use_chap_auth = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.volume_backend_name = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.volume_clear  = zero {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.volume_clear_ionice = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.volume_clear_size = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_reports.file_event_handler = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_reports.log_dir           = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.backend_availability_zone = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.backend_host         = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.chap_password        = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.chap_username        = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.disk_geometry        = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.driver_client_cert   = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.driver_data_namespace = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.extra_capabilities   = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.filter_function      = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.goodness_function    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.iser_helper          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.iser_ip_address      = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.iser_port            = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_host             = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_login            = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_mount_options    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_password         = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_private_key      = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_share_path       = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.num_shell_tries      = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.replication_device   = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.report_discard_supported = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.reserved_percentage  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.scst_target_driver   = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.storage_protocol     = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.target_helper        = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.target_ip_address    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.target_port          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.target_prefix        = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.target_protocol      = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.trace_flags          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.use_chap_auth        = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.volume_clear         = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.volume_clear_size    = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] QuobyteHD.volumes_dir          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack quobyte-client[82720]: Reading configuration file: /etc/quobyte/client.cfg
Feb 27 02:00:15 devstack quobyte-client[82720]: Invalid parameters found, error: missing mount point.
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack quobyte-client[82720]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack quobyte-client[82720]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=82719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:00:15 devstack cinder-volume[82719]: INFO cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad ...
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 -c /etc/quobyte/client-cinder.cfg {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_notifications.driver = [] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_notifications.retry = -1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] key_manager.fixed_key          = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.barbican_api_version  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.barbican_endpoint     = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.barbican_endpoint_type = public {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.barbican_region_name  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.cafile                = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.certfile              = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.collect_timing        = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.insecure              = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.keyfile               = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.number_of_retries     = 60 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.retry_delay           = 1 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.send_service_user_token = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.split_loggers         = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.timeout               = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.verify_ssl            = True {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican.verify_ssl_path       = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican_service_user.auth_section = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican_service_user.auth_type = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican_service_user.cafile   = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican_service_user.certfile = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican_service_user.collect_timing = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican_service_user.insecure = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican_service_user.keyfile  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack sudo[82724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 -c /etc/quobyte/client-cinder.cfg
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican_service_user.split_loggers = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] barbican_service_user.timeout  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack sudo[82724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.approle_role_id          = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.approle_secret_id        = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.kv_mountpoint            = secret {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.kv_path                  = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.kv_version               = 2 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.namespace                = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.root_token_id            = **** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.ssl_ca_crt_file          = None {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.timeout                  = 60.0 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.use_ssl                  = False {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:15 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] ******************************************************************************** {{(pid=82604) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 27 02:00:15 devstack sudo[82724]: pam_unix(sudo:session): session closed for user root
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.475s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:15 devstack cinder-volume[82719]: INFO cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad succeeded
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=82719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.486s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:00:15 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:15 devstack sudo[82793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:00:15 devstack sudo[82793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:00:16 devstack sudo[82793]: pam_unix(sudo:session): session closed for user root
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.434s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:16 devstack cinder-volume[82719]: INFO cinder.volume.driver [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Driver hasn't implemented _init_vendor_properties()
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.volume.driver [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82719) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_db.sqlalchemy.engines [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG dbcounter [-] [82719] Writer thread running {{(pid=82719) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.db.sqlalchemy.api [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Building query based on filter {{(pid=82719) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.image.image_utils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82719) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 27 02:00:16 devstack cinder-volume[82719]: INFO cinder.keymgr.migration [None req-23b3cd64-7385-45cb-b7d3-aea55f46895a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=82719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=82719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:16 devstack sudo[82796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:00:16 devstack sudo[82796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:00:16 devstack sudo[82796]: pam_unix(sudo:session): session closed for user root
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.387s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.manager [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Notifying Schedulers of capabilities ... {{(pid=82719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:00:16 devstack cinder-volume[82719]: INFO cinder.volume.manager [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Driver initialization completed successfully.
Feb 27 02:00:16 devstack cinder-volume[82719]: INFO cinder.manager [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Initiating service 3 cleanup
Feb 27 02:00:16 devstack cinder-volume[82719]: INFO cinder.manager [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Service 3 cleanup completed.
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.service [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Creating RPC server for service cinder-volume {{(pid=82719) start /opt/stack/cinder/cinder/service.py:231}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.service [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82719) start /opt/stack/cinder/cinder/service.py:237}}
Feb 27 02:00:16 devstack cinder-volume[82719]: INFO cinder.volume.manager [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=82719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=82719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:00:16 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:16 devstack sudo[82800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:00:16 devstack sudo[82800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:00:17 devstack sudo[82800]: pam_unix(sudo:session): session closed for user root
Feb 27 02:00:17 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.444s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:17 devstack cinder-volume[82719]: INFO cinder.volume.manager [None req-dffca16b-fa65-4fab-bd64-1ccc2b9ed6fa None None] Driver post RPC initialization completed successfully.
Feb 27 02:00:20 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-f75599b9-d25e-45cc-9252-d835dd8c93d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:00:20 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-f75599b9-d25e-45cc-9252-d835dd8c93d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:00:20 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-f75599b9-d25e-45cc-9252-d835dd8c93d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=82719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:00:20 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-f75599b9-d25e-45cc-9252-d835dd8c93d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=82719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:00:20 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-f75599b9-d25e-45cc-9252-d835dd8c93d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:00:20 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-f75599b9-d25e-45cc-9252-d835dd8c93d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:20 devstack sudo[82867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:00:20 devstack sudo[82867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:00:20 devstack sudo[82867]: pam_unix(sudo:session): session closed for user root
Feb 27 02:00:20 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-f75599b9-d25e-45cc-9252-d835dd8c93d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.378s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:20 devstack cinder-volume[82719]: DEBUG cinder.manager [None req-f75599b9-d25e-45cc-9252-d835dd8c93d3 None None] Notifying Schedulers of capabilities ... {{(pid=82719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:00:22 devstack cinder-volume[82604]: INFO oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Caught SIGTERM, stopping children
Feb 27 02:00:22 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Acquiring lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 02:00:22 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Acquired lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 02:00:22 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Releasing lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 02:00:22 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Stop services. {{(pid=82604) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Feb 27 02:00:22 devstack cinder-volume[82604]: DEBUG oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Killing children. {{(pid=82604) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Feb 27 02:00:22 devstack cinder-volume[82604]: INFO oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Waiting on 1 children to exit
Feb 27 02:00:25 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Acquiring lock "singleton_lock" {{(pid=82719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 02:00:25 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Acquired lock "singleton_lock" {{(pid=82719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 02:00:25 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Releasing lock "singleton_lock" {{(pid=82719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 02:00:25 devstack cinder-volume[82719]: WARNING amqp [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 02:00:25 devstack cinder-volume[82719]: WARNING amqp [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Feb 27 02:00:25 devstack cinder-volume[82604]: INFO oslo_service.backend._eventlet.service [None req-a7bad46c-d786-42ba-aa92-cad7f41f0902 None None] Child 82719 exited with status 0
Feb 27 02:00:27 devstack cinder-volume[82947]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82947) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Feb 27 02:00:27 devstack cinder-volume[82947]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82947) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Feb 27 02:00:27 devstack cinder-volume[82947]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82947) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Feb 27 02:00:27 devstack cinder-volume[82947]: INFO dbcounter [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Registered counter for database cinder
Feb 27 02:00:27 devstack cinder-volume[82947]: DEBUG oslo_db.sqlalchemy.engines [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 02:00:27 devstack cinder-volume[82947]: DEBUG dbcounter [-] [82947] Writer thread running {{(pid=82947) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 02:00:27 devstack cinder-volume[82947]: INFO cinder.rpc [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Feb 27 02:00:28 devstack cinder-volume[82947]: INFO cinder.rpc [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_db.sqlalchemy.engines [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 02:00:28 devstack cinder-volume[82947]: INFO cinder.volume.manager [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Determined volume DB was empty at startup.
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG cinder.volume.manager [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82947) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Feb 27 02:00:28 devstack cinder-volume[82947]: WARNING stevedore.named [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Feb 27 02:00:28 devstack cinder-volume[82947]: WARNING castellan.key_manager [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 02:00:28 devstack cinder-volume[82947]: WARNING cinder.keymgr.conf_key_mgr [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Feb 27 02:00:28 devstack cinder-volume[82947]: INFO cinder.volume.manager [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_db.sqlalchemy.engines [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 02:00:28 devstack cinder-volume[82947]: INFO oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Starting 1 workers
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Started child 83140 {{(pid=82947) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Full set of CONF: {{(pid=82947) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] ******************************************************************************** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Configuration options gathered from: {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] ================================================================================ {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Feb 27 02:00:28 devstack cinder-volume[83140]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] allow_availability_zone_fallback = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] allow_compression_on_image_upload = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] allowed_direct_url_schemes     = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] api_rate_limit                 = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] auth_strategy                  = keystone {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_availability_zone      = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_host                   = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_name                   = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_stats_polling_interval = 60 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backup_api_class               = cinder.backup.api.API {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backup_name_template           = backup-%s {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backup_use_same_host           = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backup_use_temp_snapshot       = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] chap_password                  = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] chap_username                  =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cinder_internal_tenant_project_id = 7f9b7e1935314cee91fb56958d73a79c {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cinder_internal_tenant_user_id = 5fa56760f3ed44a0badb9c64e123ee67 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cluster                        = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] compression_format             = gzip {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] config_dir                     = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] config_source                  = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] control_exchange               = openstack {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] debug                          = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] default_availability_zone      = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] default_group_type             = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] default_volume_type            = QuobyteHD {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] disk_geometry                  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] driver_client_cert             = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] driver_client_cert_key         = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] driver_data_namespace          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] driver_ssl_cert_path           = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] driver_ssl_cert_verify         = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] driver_use_ssl                 = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] enable_new_services            = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] enable_unsupported_driver      = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] enforce_multipath_for_image_xfer = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] filter_function                = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_api_insecure            = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_api_servers             = ['http://192.168.122.18/image'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_api_ssl_compression     = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_ca_certificates_file    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_certfile                = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_keyfile                 = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_num_retries             = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance_request_timeout         = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] goodness_function              = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] graceful_shutdown_timeout      = 5 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] group_api_class                = cinder.group.api.API {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] host                           = devstack {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_compress_on_upload       = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_conversion_address_space_limit = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_conversion_cpu_limit     = 60 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_conversion_disable       = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_upload_use_cinder_backend = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_upload_use_internal_tenant = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_volume_cache_enabled     = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_volume_cache_max_count   = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] image_volume_cache_max_size_gb = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] init_host_max_objects_retrieval = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] iscsi_target_flags             =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] iscsi_write_cache              = on {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Starting volume driver QuobyteDriver (1.1.14)
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] iser_helper                    = tgtadm {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] iser_ip_address                = 192.168.122.18 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83140) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] iser_port                      = 3260 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] log_color                      = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] log_config_append              = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] log_dir                        = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] log_file                       = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] log_options                    = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] log_rotate_interval            = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] log_rotate_interval_type       = days {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] log_rotation_type              = none {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] max_age                        = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] max_logfile_count              = 30 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] max_logfile_size_mb            = 200 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] max_over_subscription_ratio    = 20.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] message_reap_interval          = 86400 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] message_ttl                    = 2592000 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] migration_create_volume_timeout_secs = 300 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] monkey_patch                   = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] monkey_patch_modules           = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] my_ip                          = 192.168.122.18 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] no_snapshot_gb_quota           = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] num_iser_scan_tries            = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] num_shell_tries                = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] num_volume_device_scan_tries   = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] nvmeof_conn_info_version       = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] nvmet_ns_id                    = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] nvmet_port_id                  = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] osapi_max_limit                = 1000 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] osapi_volume_ext_list          = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] osapi_volume_listen_port       = 8776 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] osapi_volume_use_ssl           = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] osapi_volume_workers           = 2 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] per_volume_size_limit          = -1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] periodic_fuzzy_delay           = 60 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] periodic_interval              = 60 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] public_endpoint                = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] publish_errors                 = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] quota_backup_gigabytes         = 1000 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] quota_backups                  = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] quota_gigabytes                = 1000 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] quota_groups                   = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] quota_snapshots                = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] quota_volumes                  = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] rate_limit_burst               = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] rate_limit_except_level        = CRITICAL {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] rate_limit_interval            = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] reinit_driver_count            = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] replication_device             = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] report_discard_supported       = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] report_interval                = 120 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] reservation_clean_interval     = 86400 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] reservation_expire             = 86400 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] reserved_image_namespaces      = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] reserved_percentage            = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] rpc_response_timeout           = 120 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] run_external_periodic_tasks    = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] scst_target_driver             = iscsi {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] scst_target_iqn_name           = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_down_time              = 720 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] shell_completion               = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] snapshot_name_template         = snapshot-%s {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] split_loggers                  = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] state_path                     = /opt/stack/data/cinder {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] storage_availability_zone      = nova {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] storage_protocol               = iSCSI {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] syslog_log_facility            = LOG_USER {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] target_helper                  = lioadm {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] target_ip_address              = 192.168.122.18 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] target_port                    = 3260 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] target_protocol                = iscsi {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] target_secondary_ip_addresses  = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] trace_flags                    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] transport_url                  = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] until_refresh                  = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] use_chap_auth                  = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] use_default_quota_class        = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] use_journal                    = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] use_json                       = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] use_multipath_for_image_xfer   = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] use_stderr                     = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] use_syslog                     = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] verify_glance_signatures       = enabled {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_api_class               = cinder.volume.api.API {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_backend_name            = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_clear                   = zero {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_clear_ionice            = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_clear_size              = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_copy_bps_limit          = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_dd_blocksize            = 1M {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_name_template           = volume-%s {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_service_inithost_offload = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volume_usage_audit_period      = month {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] zoning_mode                    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83140) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Feb 27 02:00:28 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.quobyte [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Feb 27 02:00:28 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.quobyte [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_concurrency.disable_process_locking = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.admin_password = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Running cmd (subprocess): mount.quobyte {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.admin_token = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.admin_user  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.auth_protocol = https {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.auth_section = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.auth_type   = password {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.auth_uri    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.auth_version = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.cache       = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.certfile    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.identity_uri = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.include_service_catalog = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.insecure    = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.interface   = public {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.keyfile     = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_password =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcache_username =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.region_name = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.service_type = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.18/identity {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.backend                  = dogpile.cache.null {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.backend_argument         = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.backend_expiration_time  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.config_prefix            = cache.oslo {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.debug_cache_backend      = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.enable_retry_client      = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.enable_socket_keepalive  = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.enabled                  = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.enforce_fips_mode        = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.expiration_time          = 600 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.hashclient_retry_attempts = 2 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.memcache_dead_retry      = 300 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.memcache_sasl_enabled    = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.password                 = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.proxies                  = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.redis_db                 = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.redis_server             = localhost:6379 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.retry_attempts           = 2 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.retry_delay              = 0.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.socket_keepalive_count   = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.socket_keepalive_idle    = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.socket_keepalive_interval = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.socket_timeout           = 1.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.tls_allowed_ciphers      = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.tls_cafile               = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.tls_certfile             = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.tls_enabled              = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.tls_keyfile              = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cache.username                 = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] coordination.backend_url       = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.asyncio_connection    = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.asyncio_slave_connection = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.backend               = sqlalchemy {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.connection            = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.connection_debug      = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.connection_parameters =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.connection_recycle_time = 3600 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.connection_trace      = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.db_inc_retry_interval = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.db_max_retries        = 20 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.db_max_retry_interval = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.db_retry_interval     = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.max_overflow          = 50 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.max_pool_size         = 5 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.max_retries           = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.mysql_wsrep_sync_wait = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack quobyte-client[83141]: Reading configuration file: /etc/quobyte/client.cfg
Feb 27 02:00:28 devstack quobyte-client[83141]: Invalid parameters found, error: missing mount point.
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.pool_timeout          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack quobyte-client[83141]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.retry_interval        = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack quobyte-client[83141]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.slave_connection      = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.sqlite_synchronous    = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.synchronous_reader    = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] database.use_db_reconnect      = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.connection_string     = messaging:// {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.enabled               = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.es_doc_type           = notification {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.es_scroll_size        = 10000 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.es_scroll_time        = 2m {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.filter_error_trace    = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.hmac_keys             = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.sentinel_service_name = mymaster {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.socket_timeout        = 0.1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.trace_requests        = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler.trace_sqlalchemy      = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler_jaeger.process_tags   = {} {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler_jaeger.service_name_prefix = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] profiler_otlp.service_name_prefix = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.enforce_new_defaults = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: WARNING oslo_config.cfg [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.enforce_scope      = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.policy_default_rule = default {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] privsep_osbrick.group          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] privsep_osbrick.helper_command = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] privsep_osbrick.user           = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cinder_sys_admin.group         = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cinder_sys_admin.helper_command = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] cinder_sys_admin.user          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.auth_section      = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.auth_type         = password {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.cafile            = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.certfile          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.collect_timing    = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.insecure          = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.keyfile           = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.send_service_user_token = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.split_loggers     = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] service_user.timeout           = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.auth_section            = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.auth_type               = password {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.certfile                = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.collect_timing          = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.insecure                = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.keyfile                 = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack sudo[83142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.region_name             = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.split_loggers           = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack sudo[83142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] glance.timeout                 = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.backend_availability_zone = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.chap_password = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.chap_username =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.disk_geometry = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.driver_client_cert = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.driver_client_cert_key = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.driver_data_namespace = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.driver_use_ssl = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.extra_capabilities = {} {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.filter_function = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.goodness_function = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.iscsi_target_flags =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.iscsi_write_cache = on {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.iser_ip_address = 192.168.122.18 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.iser_port     = 3260 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_host      =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_login     = admin {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_mount_options = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_password  = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_private_key =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_share_path =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.num_shell_tries = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.quobyte_volume_url = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.replication_device = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.report_discard_supported = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.reserved_percentage = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.target_helper = tgtadm {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.target_ip_address = 192.168.122.18 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.target_port   = 3260 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.target_protocol = iscsi {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.trace_flags   = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.unique_fqdn_network = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.use_chap_auth = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.volume_backend_name = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.volume_clear  = zero {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.volume_clear_ionice = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.volume_clear_size = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_reports.file_event_handler = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_reports.log_dir           = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.backend_availability_zone = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.backend_host         = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.chap_password        = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.chap_username        = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.disk_geometry        = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.driver_client_cert   = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.driver_data_namespace = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.extra_capabilities   = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.filter_function      = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.goodness_function    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.iser_helper          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.iser_ip_address      = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.iser_port            = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_host             = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_login            = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_mount_options    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_password         = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_private_key      = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_share_path       = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.num_shell_tries      = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.replication_device   = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.report_discard_supported = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.reserved_percentage  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.scst_target_driver   = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.storage_protocol     = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.target_helper        = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.target_ip_address    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.target_port          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.target_prefix        = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.target_protocol      = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.trace_flags          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.use_chap_auth        = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.volume_clear         = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.volume_clear_size    = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] QuobyteHD.volumes_dir          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_notifications.driver = [] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_notifications.retry = -1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] key_manager.fixed_key          = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.barbican_api_version  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.barbican_endpoint     = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.barbican_endpoint_type = public {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.barbican_region_name  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.cafile                = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.certfile              = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.collect_timing        = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.insecure              = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.keyfile               = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.number_of_retries     = 60 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.retry_delay           = 1 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.send_service_user_token = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.split_loggers         = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.timeout               = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.verify_ssl            = True {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican.verify_ssl_path       = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican_service_user.auth_section = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican_service_user.auth_type = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican_service_user.cafile   = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican_service_user.certfile = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican_service_user.collect_timing = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican_service_user.insecure = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican_service_user.keyfile  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican_service_user.split_loggers = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] barbican_service_user.timeout  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.approle_role_id          = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.approle_secret_id        = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.kv_mountpoint            = secret {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.kv_path                  = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.kv_version               = 2 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.namespace                = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.root_token_id            = **** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.ssl_ca_crt_file          = None {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.timeout                  = 60.0 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.use_ssl                  = False {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Feb 27 02:00:28 devstack cinder-volume[82947]: DEBUG oslo_service.backend._eventlet.service [None req-53fb4199-d467-4d4d-959b-22d72eca64f3 None None] ******************************************************************************** {{(pid=82947) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Feb 27 02:00:28 devstack sudo[83142]: pam_unix(sudo:session): session closed for user root
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.392s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:28 devstack cinder-volume[83140]: INFO cinder.volume.driver [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Driver hasn't implemented _init_vendor_properties()
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG cinder.volume.driver [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83140) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_db.sqlalchemy.engines [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writer thread running {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG cinder.db.sqlalchemy.api [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Building query based on filter {{(pid=83140) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83140) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:00:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:28 devstack cinder-volume[83140]: INFO cinder.keymgr.migration [None req-1fc64421-4f0c-4bfb-8214-280b74dba913 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Feb 27 02:00:28 devstack sudo[83181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:00:28 devstack sudo[83181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:00:29 devstack sudo[83181]: pam_unix(sudo:session): session closed for user root
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.379s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:00:29 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Driver initialization completed successfully.
Feb 27 02:00:29 devstack cinder-volume[83140]: INFO cinder.manager [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Initiating service 3 cleanup
Feb 27 02:00:29 devstack cinder-volume[83140]: INFO cinder.manager [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Service 3 cleanup completed.
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG cinder.service [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Creating RPC server for service cinder-volume {{(pid=83140) start /opt/stack/cinder/cinder/service.py:231}}
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG cinder.service [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83140) start /opt/stack/cinder/cinder/service.py:237}}
Feb 27 02:00:29 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:00:29 devstack sudo[83196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:00:29 devstack sudo[83196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:00:29 devstack sudo[83196]: pam_unix(sudo:session): session closed for user root
Feb 27 02:00:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.398s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:00:29 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-244cd5c2-03ec-45e9-8704-299d87c3e596 None None] Driver post RPC initialization completed successfully.
Feb 27 02:00:38 devstack cinder-volume[82947]: DEBUG dbcounter [-] [82947] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82947) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:00:39 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=1 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:00:39 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:01:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a4882d93-a965-4819-b750-fe0b9526932e tempest-BackendsCapabilitiesAdminTestsJSON-1312040226 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83140) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 27 02:01:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b48a78a2-9b2f-4696-8f22-618d0c4931ec tempest-BackendsCapabilitiesAdminTestsJSON-1312040226 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83140) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Feb 27 02:01:28 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:01:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Flow 'volume_create_manager' (a4eca4a6-2f00-4217-9b19-3057f50fede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a80534d-8c2f-42d7-9be6-fadbc90e7058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a80534d-8c2f-42d7-9be6-fadbc90e7058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-774565207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5859123-a586-4c30-babf-f9d74a017f78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='070513f5d3a340919beb90b4a2d8085d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:29Z,use_quota=True,user_id='7a67898c2dcc40cba02a3e29cab31fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf648b2a-8739-4848-9fbc-cc2697fe5a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf648b2a-8739-4848-9fbc-cc2697fe5a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29f747a-a376-43aa-8887-1c77e5e8dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29f747a-a376-43aa-8887-1c77e5e8dc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5859123-a586-4c30-babf-f9d74a017f78', 'volume_name': 'volume-f5859123-a586-4c30-babf-f9d74a017f78', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf0e76e-73a6-43d7-996e-04884a3f0549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf0e76e-73a6-43d7-996e-04884a3f0549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d9c985-7d74-4634-b968-b2f6dcbc000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:29 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Volume f5859123-a586-4c30-babf-f9d74a017f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5859123-a586-4c30-babf-f9d74a017f78', 'volume_size': 1}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-774565207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5859123-a586-4c30-babf-f9d74a017f78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='070513f5d3a340919beb90b4a2d8085d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:29Z,use_quota=True,user_id='7a67898c2dcc40cba02a3e29cab31fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Creating volume f5859123-a586-4c30-babf-f9d74a017f78 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:01:29 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:29 devstack sudo[83516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78 1073741824
Feb 27 02:01:29 devstack sudo[83516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:29 devstack sudo[83516]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78 1073741824" returned: 0 in 0.686s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:29 devstack sudo[83836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78
Feb 27 02:01:29 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:30 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78" returned: 0 in 0.621s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:30 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:01:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d9c985-7d74-4634-b968-b2f6dcbc000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5859123-a586-4c30-babf-f9d74a017f78', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db755c5-8ac2-488a-81fb-cd10be2ade40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:30 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Volume volume-f5859123-a586-4c30-babf-f9d74a017f78 (f5859123-a586-4c30-babf-f9d74a017f78): created successfully
Feb 27 02:01:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db755c5-8ac2-488a-81fb-cd10be2ade40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Flow 'volume_create_manager' (a4eca4a6-2f00-4217-9b19-3057f50fede8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:30 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-fd594fab-341c-4d85-9748-8ca6ec819e1f req-1565a7bb-8eca-4ce5-b762-b79fd3998287 tempest-VolumesGetTestJSON-238989712 None] Created volume successfully.
Feb 27 02:01:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Acquiring lock "cinder-f5859123-a586-4c30-babf-f9d74a017f78-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:01:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Lock "cinder-f5859123-a586-4c30-babf-f9d74a017f78-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:01:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Acquiring lock "cinder-quobyte-f5859123-a586-4c30-babf-f9d74a017f78" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:01:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Lock "cinder-quobyte-f5859123-a586-4c30-babf-f9d74a017f78" acquired by "delete_volume" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:01:31 devstack cinder-volume[83140]: INFO oslo.privsep.daemon [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpphbimr96/privsep.sock']
Feb 27 02:01:31 devstack sudo[83840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpphbimr96/privsep.sock
Feb 27 02:01:31 devstack sudo[83840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:32 devstack sudo[83840]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:32 devstack cinder-volume[83140]: INFO oslo.privsep.daemon [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Spawned new privsep daemon via rootwrap
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Accepted privsep connection to /tmp/tmpphbimr96/privsep.sock {{(pid=83140) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Feb 27 02:01:32 devstack cinder-volume[83140]: INFO oslo.privsep.daemon [-] privsep daemon starting
Feb 27 02:01:32 devstack cinder-volume[83140]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Feb 27 02:01:32 devstack cinder-volume[83140]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Feb 27 02:01:32 devstack cinder-volume[83140]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83843
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a374b0f-34b4-4fee-b118-9ffbcb49b6c6]: (2,) {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[46061188-c5da-47f5-9acd-6b7d44630f33]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:32 devstack sudo[83846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:01:32 devstack sudo[83846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:32 devstack sudo[83845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78
Feb 27 02:01:32 devstack sudo[83845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:33 devstack sudo[83845]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78" returned: 0 in 0.903s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:33 devstack sudo[83854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78
Feb 27 02:01:33 devstack sudo[83854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:33 devstack sudo[83846]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.156s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:01:33 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Flow 'volume_create_manager' (0acbb7e5-7aed-418e-b2f1-617b47a20e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df4ab39-cfab-4927-93f2-ad0d66f60372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df4ab39-cfab-4927-93f2-ad0d66f60372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1387240310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0823783-9386-49fd-84a9-43661b2c99dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da49d256364cfe895457fe3af79805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:34Z,use_quota=True,user_id='466c938cce294c71a09cdba4b5eb32dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:34 devstack sudo[83854]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689d2328-edc2-4564-8723-8d65ba40b350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689d2328-edc2-4564-8723-8d65ba40b350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1fa099-c318-4d31-9572-27f80e44042d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1fa099-c318-4d31-9572-27f80e44042d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0823783-9386-49fd-84a9-43661b2c99dc', 'volume_name': 'volume-f0823783-9386-49fd-84a9-43661b2c99dc', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1747e1b-4930-4d3b-b48c-98df22a13123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1747e1b-4930-4d3b-b48c-98df22a13123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc679cf-6d65-4d30-9e1a-20d1a490a754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:34 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Volume f0823783-9386-49fd-84a9-43661b2c99dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0823783-9386-49fd-84a9-43661b2c99dc', 'volume_size': 1}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1387240310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0823783-9386-49fd-84a9-43661b2c99dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da49d256364cfe895457fe3af79805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:34Z,use_quota=True,user_id='466c938cce294c71a09cdba4b5eb32dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Creating volume f0823783-9386-49fd-84a9-43661b2c99dc {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:01:34 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f5859123-a586-4c30-babf-f9d74a017f78" returned: 0 in 0.828s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Lock "cinder-quobyte-f5859123-a586-4c30-babf-f9d74a017f78" released by "delete_volume" :: held 3.241s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:01:34 devstack sudo[83858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc 1073741824
Feb 27 02:01:34 devstack sudo[83858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:34 devstack cinder-volume[83140]: WARNING cinder.quota [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:01:34 devstack cinder-volume[83140]: WARNING cinder.quota [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.quota [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Created reservations ['5432dcaf-0be7-4cfd-b820-58a80d52f14d', 'ee262554-93df-4ca2-acfb-500415da7079', '54de58ba-63b1-4246-b4bf-1f86a8b799d4', '54b5955b-76e7-45af-a8ea-f530433189d3'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:34 devstack sudo[83861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:01:34 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:01:36 devstack sudo[83858]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Flow 'volume_create_manager' (e31ae0d8-a271-4ee3-b590-bf93b8aa70fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00552fb6-1d4e-4eae-9ef8-9cf00b0579b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc 1073741824" returned: 0 in 1.964s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00552fb6-1d4e-4eae-9ef8-9cf00b0579b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:36Z,deleted=False,deleted_at=None,display_description='',display_name='56b7e7ab-0d1e-4351-bb34-00162b306cfb-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b567e5-f985-4802-9ba4-34c8c1201b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5957d0a5c9bf4b23918b1b0de97fdd4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:36Z,use_quota=True,user_id='1382e87c3b01444d85a23765bfadb926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710e6bdc-c5e5-49b9-8339-b6fdb7391f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710e6bdc-c5e5-49b9-8339-b6fdb7391f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c12eb3-a10e-432d-aca1-c08a92f7840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c12eb3-a10e-432d-aca1-c08a92f7840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b567e5-f985-4802-9ba4-34c8c1201b57', 'volume_name': 'volume-75b567e5-f985-4802-9ba4-34c8c1201b57', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1614c013-5339-4d89-9503-60676a63db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1614c013-5339-4d89-9503-60676a63db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e655563-8244-4eee-98b8-e61f7283085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:36 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Volume 75b567e5-f985-4802-9ba4-34c8c1201b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b567e5-f985-4802-9ba4-34c8c1201b57', 'volume_size': 1}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:36 devstack sudo[83868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc
Feb 27 02:01:36 devstack sudo[83868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:36 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.951s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.manager [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:01:36 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Deleted volume successfully.
Feb 27 02:01:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-e9168d92-35b9-41d0-a9e7-aba1c05b9de3 req-7ea7c5fc-d7de-4aa3-b324-09c02cea6b61 tempest-VolumesGetTestJSON-238989712 None] Lock "cinder-f5859123-a586-4c30-babf-f9d74a017f78-delete_volume" released by "delete_volume" :: held 5.653s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:01:37 devstack sudo[83868]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc" returned: 0 in 1.438s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] <== create_volume: return (3682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.689s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:36Z,deleted=False,deleted_at=None,display_description='',display_name='56b7e7ab-0d1e-4351-bb34-00162b306cfb-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b567e5-f985-4802-9ba4-34c8c1201b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5957d0a5c9bf4b23918b1b0de97fdd4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:36Z,use_quota=True,user_id='1382e87c3b01444d85a23765bfadb926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Creating volume 75b567e5-f985-4802-9ba4-34c8c1201b57 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:01:37 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc679cf-6d65-4d30-9e1a-20d1a490a754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0823783-9386-49fd-84a9-43661b2c99dc', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd5faaa-d136-4bc9-a90c-308509b5acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:37 devstack sudo[83907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57 1073741824
Feb 27 02:01:37 devstack sudo[83907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:37 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Volume volume-f0823783-9386-49fd-84a9-43661b2c99dc (f0823783-9386-49fd-84a9-43661b2c99dc): created successfully
Feb 27 02:01:37 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd5faaa-d136-4bc9-a90c-308509b5acdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Flow 'volume_create_manager' (0acbb7e5-7aed-418e-b2f1-617b47a20e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:38 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-96326b48-1227-4b91-b6b8-1357254603e3 tempest-VolumesAdminNegativeTest-1509401343 None] Created volume successfully.
Feb 27 02:01:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Acquiring lock "cinder-f0823783-9386-49fd-84a9-43661b2c99dc-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:01:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "cinder-f0823783-9386-49fd-84a9-43661b2c99dc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:01:39 devstack sudo[83907]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57 1073741824" returned: 0 in 1.553s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Acquiring lock "cinder-quobyte-f0823783-9386-49fd-84a9-43661b2c99dc" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:01:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "cinder-quobyte-f0823783-9386-49fd-84a9-43661b2c99dc" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:01:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:39 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de1dcc-22c7-432c-9637-4085dc195988]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:01:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:39 devstack sudo[83918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57
Feb 27 02:01:39 devstack sudo[83918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:39 devstack sudo[83919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc
Feb 27 02:01:39 devstack sudo[83919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:40 devstack sudo[83918]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57" returned: 0 in 0.739s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:01:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.402s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:40 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e655563-8244-4eee-98b8-e61f7283085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b567e5-f985-4802-9ba4-34c8c1201b57', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:40 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795c6df3-acc5-47ca-8f75-5c249be7cdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:40 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Volume volume-75b567e5-f985-4802-9ba4-34c8c1201b57 (75b567e5-f985-4802-9ba4-34c8c1201b57): created successfully
Feb 27 02:01:40 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795c6df3-acc5-47ca-8f75-5c249be7cdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:40 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Flow 'volume_create_manager' (e31ae0d8-a271-4ee3-b590-bf93b8aa70fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:40 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-1345846d-1a35-469f-b3d6-a62318593b9e tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Created volume successfully.
Feb 27 02:01:41 devstack sudo[83919]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc" returned: 0 in 1.432s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:41 devstack sudo[83943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc
Feb 27 02:01:41 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:41 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f0823783-9386-49fd-84a9-43661b2c99dc" returned: 0 in 0.547s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "cinder-quobyte-f0823783-9386-49fd-84a9-43661b2c99dc" released by "delete_volume" :: held 2.033s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Created reservations ['3364d0b6-1d3e-4adb-95df-1781345c9521', 'ae20710c-e7bd-48b9-8dd5-77589f28ea50', 'addb7a54-80a1-4729-aaab-08a7a19a8777', '634cee25-4b9d-4598-a6e9-b956b630bf32'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:41 devstack sudo[83946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:01:41 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:42 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.936s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:42 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:01:42 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Deleted volume successfully.
Feb 27 02:01:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b55dbae8-4f14-4e61-879e-e523619a0276 tempest-VolumesAdminNegativeTest-1509401343 None] Lock "cinder-f0823783-9386-49fd-84a9-43661b2c99dc-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Flow 'volume_create_manager' (cf8d6f48-fedb-4fcf-b87e-78fab395faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d228e76c-08c0-4a59-85a9-38d24b28b9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d228e76c-08c0-4a59-85a9-38d24b28b9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1310984388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4e126c32f642f793b72d94ab272eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:45Z,use_quota=True,user_id='dfef182b6609475f9e2f76a825cef30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b8a253-d59f-48d2-8761-d11507305eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b8a253-d59f-48d2-8761-d11507305eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bc64de-09d3-49bc-9921-5d41d4776599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bc64de-09d3-49bc-9921-5d41d4776599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c', 'volume_name': 'volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bef39df-b2cc-4305-9979-43801f7c4c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bef39df-b2cc-4305-9979-43801f7c4c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441e6694-2ab0-47af-94a4-1e55119f3f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:45 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Volume 96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c', 'volume_size': 1}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1310984388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4e126c32f642f793b72d94ab272eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:45Z,use_quota=True,user_id='dfef182b6609475f9e2f76a825cef30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Creating volume 96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:01:45 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:45 devstack sudo[83976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c 1073741824
Feb 27 02:01:45 devstack sudo[83976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:45 devstack cinder-volume[83140]: WARNING py.warnings [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-db138bb6-7b97-4dad-83d2-1a3237d8d157 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Feb 27 02:01:45 devstack cinder-volume[83140]:   .first()
Feb 27 02:01:45 devstack cinder-volume[83140]: 
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-db138bb6-7b97-4dad-83d2-1a3237d8d157 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:45 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-50ea203f-aee9-417e-8d1f-cd6507ad5f3a tempest-GroupsTest-676465181 None] Group tempest-Group1-823335977: creating
Feb 27 02:01:45 devstack sudo[83976]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c 1073741824" returned: 0 in 0.672s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:45 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-50ea203f-aee9-417e-8d1f-cd6507ad5f3a tempest-GroupsTest-676465181 None] Group tempest-Group1-823335977: created successfully
Feb 27 02:01:45 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-50ea203f-aee9-417e-8d1f-cd6507ad5f3a tempest-GroupsTest-676465181 None] Create group completed successfully.
Feb 27 02:01:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:45 devstack sudo[83990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c
Feb 27 02:01:45 devstack sudo[83990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:46 devstack sudo[83990]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c" returned: 0 in 0.517s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-db138bb6-7b97-4dad-83d2-1a3237d8d157 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.743s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441e6694-2ab0-47af-94a4-1e55119f3f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cd2fce-453e-4a1e-91e7-c92222191de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c938f3f-7713-4afe-b673-a4786ff46ff7]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-db138bb6-7b97-4dad-83d2-1a3237d8d157 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:46 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Volume volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c (96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c): created successfully
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cd2fce-453e-4a1e-91e7-c92222191de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Flow 'volume_create_manager' (cf8d6f48-fedb-4fcf-b87e-78fab395faae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:46 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d3d4d457-de7a-447c-a623-594746171815 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Created volume successfully.
Feb 27 02:01:46 devstack sudo[83994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57
Feb 27 02:01:46 devstack sudo[83994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:46 devstack sudo[83994]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-db138bb6-7b97-4dad-83d2-1a3237d8d157 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57" returned: 0 in 0.512s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-db138bb6-7b97-4dad-83d2-1a3237d8d157 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.528s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-a8c54937-5a15-4867-9136-ab6a2edc6e2b tempest-GroupsTest-676465181 None] Group tempest-Group2-57938216: creating
Feb 27 02:01:47 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-db138bb6-7b97-4dad-83d2-1a3237d8d157 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad', 'name': 'volume-75b567e5-f985-4802-9ba4-34c8c1201b57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31309f17-f8ca-4123-aba1-8d4e1ff00676', 'enforce_multipath': True} {{(pid=83140) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 27 02:01:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-a8c54937-5a15-4867-9136-ab6a2edc6e2b tempest-GroupsTest-676465181 None] Group tempest-Group2-57938216: created successfully
Feb 27 02:01:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-a8c54937-5a15-4867-9136-ab6a2edc6e2b tempest-GroupsTest-676465181 None] Create group completed successfully.
Feb 27 02:01:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-2dfe211e-1e5f-4357-85c4-904141112c80 req-db138bb6-7b97-4dad-83d2-1a3237d8d157 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] attachment_update completed successfully.
Feb 27 02:01:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Acquiring lock "cinder-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:01:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "cinder-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:01:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Acquiring lock "cinder-quobyte-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:01:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "cinder-quobyte-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:01:47 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f631fe-ff26-4700-90dd-b5b97e2a3423]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:01:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:47 devstack sudo[83999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c
Feb 27 02:01:47 devstack sudo[83999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:47 devstack sudo[83999]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c" returned: 0 in 0.633s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:47 devstack sudo[84005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c
Feb 27 02:01:47 devstack sudo[84005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:48 devstack sudo[84005]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c" returned: 0 in 0.424s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "cinder-quobyte-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c" released by "delete_volume" :: held 1.090s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Created reservations ['8cfdbef6-4705-4f21-a301-2d3e9bd0b021', 'c0c32b4e-4c05-47dc-becc-2a983f43bdcb', '8d797dfd-4e68-41d8-9748-95524c5e6fe4', '772bf902-6df8-465b-8ade-db3aaf2d89b1'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:48 devstack sudo[84008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:01:48 devstack sudo[84008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Flow 'volume_create_manager' (4340c659-4080-4f98-8497-d12f68fdd640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03afca6e-d00a-4ec7-a403-729b957f8778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03afca6e-d00a-4ec7-a403-729b957f8778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1260460788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=34c2d684-b842-4399-9a2c-a40cbee35d20,host='devstack@QuobyteHD#QuobyteHD',id=0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ebf4e94204877b3eb245fa326ad34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:48Z,use_quota=True,user_id='c3624b98aea14563899c534896a74845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a61eec24-e9e7-4116-94d7-c5b2d788eb79),volume_type_id=a61eec24-e9e7-4116-94d7-c5b2d788eb79)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e5b424-b1c1-40f1-bfdd-17a6b7a4bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e5b424-b1c1-40f1-bfdd-17a6b7a4bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1d12a8-08af-41ec-8d10-baefa566fee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1d12a8-08af-41ec-8d10-baefa566fee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18', 'volume_name': 'volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c92993-ed09-4de5-b97b-58b007cd0406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c92993-ed09-4de5-b97b-58b007cd0406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a594c479-f20b-4ccf-a9e5-13001e0fde28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:48 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Volume 0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18', 'volume_size': 1}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=34c2d684-b842-4399-9a2c-a40cbee35d20,created_at=2026-02-27T01:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1260460788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=34c2d684-b842-4399-9a2c-a40cbee35d20,host='devstack@QuobyteHD#QuobyteHD',id=0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ebf4e94204877b3eb245fa326ad34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:48Z,use_quota=True,user_id='c3624b98aea14563899c534896a74845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a61eec24-e9e7-4116-94d7-c5b2d788eb79),volume_type_id=a61eec24-e9e7-4116-94d7-c5b2d788eb79)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Creating volume 0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:01:48 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:48 devstack sudo[84010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18 1073741824
Feb 27 02:01:48 devstack sudo[84010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:48 devstack sudo[84008]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.578s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:01:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Deleted volume successfully.
Feb 27 02:01:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-741daa66-8859-43fc-a40d-a86deee27100 tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "cinder-96ae9cc7-9ce6-4ee0-92af-7742bdd89d3c-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:01:49 devstack sudo[84010]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18 1073741824" returned: 0 in 0.619s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:49 devstack sudo[84084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18
Feb 27 02:01:49 devstack sudo[84084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Flow 'volume_create_manager' (5d4aa1c0-4ec0-4835-958d-298c2dedaf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:49 devstack sudo[84084]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4288e0e5-ef94-4e62-900b-3fbef0d0fc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4288e0e5-ef94-4e62-900b-3fbef0d0fc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1886766935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7da1c93-8229-4d96-a515-a945b32ab2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4e126c32f642f793b72d94ab272eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:50Z,use_quota=True,user_id='dfef182b6609475f9e2f76a825cef30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f46db5-6dca-427a-87d4-45cf457c2bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f46db5-6dca-427a-87d4-45cf457c2bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1774db31-c73d-4c32-832a-9ec7bcc88367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1774db31-c73d-4c32-832a-9ec7bcc88367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7da1c93-8229-4d96-a515-a945b32ab2e4', 'volume_name': 'volume-c7da1c93-8229-4d96-a515-a945b32ab2e4', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b10b2e-ac32-41ac-a95f-7b0875b6e286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b10b2e-ac32-41ac-a95f-7b0875b6e286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7514183b-eb62-4762-b155-0b2ef91cda7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:49 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Volume c7da1c93-8229-4d96-a515-a945b32ab2e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7da1c93-8229-4d96-a515-a945b32ab2e4', 'volume_size': 1}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18" returned: 0 in 0.589s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1886766935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7da1c93-8229-4d96-a515-a945b32ab2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4e126c32f642f793b72d94ab272eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:50Z,use_quota=True,user_id='dfef182b6609475f9e2f76a825cef30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Creating volume c7da1c93-8229-4d96-a515-a945b32ab2e4 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:01:49 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a594c479-f20b-4ccf-a9e5-13001e0fde28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037a3196-2a00-461e-995b-a98a8e0af703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:49 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Volume volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18 (0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18): created successfully
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037a3196-2a00-461e-995b-a98a8e0af703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Flow 'volume_create_manager' (4340c659-4080-4f98-8497-d12f68fdd640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:49 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6ad68739-ef28-4b21-8d36-df8ee784525f tempest-GroupsTest-676465181 None] Created volume successfully.
Feb 27 02:01:49 devstack sudo[84087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4 1073741824
Feb 27 02:01:49 devstack sudo[84087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:50 devstack sudo[84087]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4 1073741824" returned: 0 in 0.609s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:50 devstack sudo[84095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4
Feb 27 02:01:50 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:50 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4" returned: 0 in 0.488s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:01:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7514183b-eb62-4762-b155-0b2ef91cda7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7da1c93-8229-4d96-a515-a945b32ab2e4', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd340083-8a8a-4588-aa98-76f93602b942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:50 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Volume volume-c7da1c93-8229-4d96-a515-a945b32ab2e4 (c7da1c93-8229-4d96-a515-a945b32ab2e4): created successfully
Feb 27 02:01:51 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd340083-8a8a-4588-aa98-76f93602b942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:51 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Flow 'volume_create_manager' (5d4aa1c0-4ec0-4835-958d-298c2dedaf62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-21e84a33-ffb1-45e3-8396-a07e1d09381a tempest-VolumeQuotasAdminTestJSON-1631658547 None] Created volume successfully.
Feb 27 02:01:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Acquiring lock "cinder-quobyte-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:01:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Lock "cinder-quobyte-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:01:51 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14bd638-faf5-48da-a254-221b08b5695d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:01:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:51 devstack sudo[84099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18
Feb 27 02:01:51 devstack sudo[84099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:51 devstack sudo[84099]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18" returned: 0 in 0.562s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:51 devstack sudo[84432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18
Feb 27 02:01:51 devstack sudo[84432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:52 devstack sudo[84432]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18" returned: 0 in 0.791s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Lock "cinder-quobyte-0cc8d17a-2f4f-4c8e-8e6c-9ff20b9faf18" released by "delete_volume" :: held 1.397s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Created reservations ['b45273f8-3d54-4895-b79a-18a89864a83f'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:01:52 devstack cinder-volume[83140]: WARNING cinder.quota [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-36879386 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-36879386, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:01:52 devstack cinder-volume[83140]: WARNING cinder.quota [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-36879386 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-36879386, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Created reservations ['400b3426-bcee-4fb0-aa73-23152b153d70', '5e5b3bac-4f8b-4b7b-b19b-d541802f27e3', '0590a3e6-5fde-45e4-800e-1cff76fdbafe', '1dfa9dc4-9616-4d66-9beb-0b201d91989a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:52 devstack sudo[84447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:01:52 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:52 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b250ca59-714a-48e6-857c-232150c6f157 tempest-VolumeQuotasAdminTestJSON-261180819 None] Transfer volume completed successfully.
Feb 27 02:01:53 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.435s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:01:53 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-c1ac77ef-089b-4b34-8716-23dd8ed399bd tempest-GroupsTest-676465181 None] Delete group completed successfully.
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] Created reservations ['e9db54a5-1a2f-4027-9afc-dd9aa2ebd127'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:53 devstack sudo[84451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:01:53 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Acquiring lock "cinder-c7da1c93-8229-4d96-a515-a945b32ab2e4-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Lock "cinder-c7da1c93-8229-4d96-a515-a945b32ab2e4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Acquiring lock "cinder-quobyte-c7da1c93-8229-4d96-a515-a945b32ab2e4" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Lock "cinder-quobyte-c7da1c93-8229-4d96-a515-a945b32ab2e4" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[185b6de8-d12b-4d8b-ab83-1b814a270aa6]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:01:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:53 devstack sudo[84453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4
Feb 27 02:01:53 devstack sudo[84453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:54 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.500s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:54 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:01:54 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8f1acfc2-e1d1-490c-894d-00d35f9a673b tempest-GroupsTest-676465181 None] Delete group completed successfully.
Feb 27 02:01:54 devstack sudo[84453]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4" returned: 0 in 0.648s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:54 devstack sudo[84460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4
Feb 27 02:01:54 devstack sudo[84460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:55 devstack sudo[84460]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7da1c93-8229-4d96-a515-a945b32ab2e4" returned: 0 in 0.554s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Lock "cinder-quobyte-c7da1c93-8229-4d96-a515-a945b32ab2e4" released by "delete_volume" :: held 1.241s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:01:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7825d0ce-3bf3-4312-ab58-b4a2a66ba42e tempest-GroupsTest-676465181 None] Group tempest-GroupsTest-Group-897408351: creating
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Created reservations ['3d74a358-f6fc-4cf9-9b00-1a7ed81d1075', 'ae18ed72-3523-414e-956c-2d6b873c95b1', 'fcf67e3a-0522-42ce-b28b-d26983bf09be', '1aa5c5bd-e557-49e1-83d5-de4d42b0ff3e'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:01:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7825d0ce-3bf3-4312-ab58-b4a2a66ba42e tempest-GroupsTest-676465181 None] Group tempest-GroupsTest-Group-897408351: created successfully
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7825d0ce-3bf3-4312-ab58-b4a2a66ba42e tempest-GroupsTest-676465181 None] Create group completed successfully.
Feb 27 02:01:55 devstack sudo[84463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:01:55 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:55 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.504s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:01:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Deleted volume successfully.
Feb 27 02:01:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-696faad1-25ed-4d48-ad0d-6423bc7b09d3 tempest-VolumeQuotasAdminTestJSON-747196376 None] Lock "cinder-c7da1c93-8229-4d96-a515-a945b32ab2e4-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Flow 'volume_create_manager' (1fbdb2e4-bf52-4ccc-a1ce-9f6c06b159c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d647d97-9e59-4799-bf6f-afcc6bdd6597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d647d97-9e59-4799-bf6f-afcc6bdd6597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343671813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b88e237e-f72f-4f71-868d-46b7c3a8dcc2,host='devstack@QuobyteHD#QuobyteHD',id=6d34f809-38f7-403a-bf5f-e5f88aa52bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ebf4e94204877b3eb245fa326ad34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:57Z,use_quota=True,user_id='c3624b98aea14563899c534896a74845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7a55a6-4817-4347-97c5-22bf646e8725),volume_type_id=3f7a55a6-4817-4347-97c5-22bf646e8725)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eda3122-b0b6-4199-95c7-be563e8c4eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eda3122-b0b6-4199-95c7-be563e8c4eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b6f08f-5c30-4492-b211-9208777ca326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b6f08f-5c30-4492-b211-9208777ca326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d34f809-38f7-403a-bf5f-e5f88aa52bce', 'volume_name': 'volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3cb0c3-2f3e-4f49-a7d1-07db77a34491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3cb0c3-2f3e-4f49-a7d1-07db77a34491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb0cdd4-1fde-409e-9b33-e99b19cc2ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Volume 6d34f809-38f7-403a-bf5f-e5f88aa52bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce', 'volume_size': 1}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b88e237e-f72f-4f71-868d-46b7c3a8dcc2,created_at=2026-02-27T01:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343671813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b88e237e-f72f-4f71-868d-46b7c3a8dcc2,host='devstack@QuobyteHD#QuobyteHD',id=6d34f809-38f7-403a-bf5f-e5f88aa52bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ebf4e94204877b3eb245fa326ad34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:57Z,use_quota=True,user_id='c3624b98aea14563899c534896a74845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7a55a6-4817-4347-97c5-22bf646e8725),volume_type_id=3f7a55a6-4817-4347-97c5-22bf646e8725)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Creating volume 6d34f809-38f7-403a-bf5f-e5f88aa52bce {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:01:56 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:01:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:56 devstack sudo[84467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce 1073741824
Feb 27 02:01:56 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:57 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce 1073741824" returned: 0 in 0.671s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:57 devstack sudo[84474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce
Feb 27 02:01:57 devstack sudo[84474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:01:57 devstack sudo[84474]: pam_unix(sudo:session): session closed for user root
Feb 27 02:01:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce" returned: 0 in 0.575s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:01:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:01:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb0cdd4-1fde-409e-9b33-e99b19cc2ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0bb629-8bca-4196-8c2f-c26479da1781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Volume volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce (6d34f809-38f7-403a-bf5f-e5f88aa52bce): created successfully
Feb 27 02:01:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0bb629-8bca-4196-8c2f-c26479da1781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Flow 'volume_create_manager' (1fbdb2e4-bf52-4ccc-a1ce-9f6c06b159c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:57 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0fecdee0-2b56-485b-b4f3-b562c54de671 tempest-GroupsTest-676465181 None] Created volume successfully.
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Flow 'volume_create_manager' (27a4521d-b627-4b71-a5fe-37a24ddc94a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff3adce-9e61-4043-94dd-cc1f1bbfb61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff3adce-9e61-4043-94dd-cc1f1bbfb61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2040426834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b88e237e-f72f-4f71-868d-46b7c3a8dcc2,host='devstack@QuobyteHD#QuobyteHD',id=414af293-3e63-4aa1-99a2-43baafb8313e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ebf4e94204877b3eb245fa326ad34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:59Z,use_quota=True,user_id='c3624b98aea14563899c534896a74845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7a55a6-4817-4347-97c5-22bf646e8725),volume_type_id=3f7a55a6-4817-4347-97c5-22bf646e8725)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d631bba6-f1cd-47df-8dfd-c76f9c9bbaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d631bba6-f1cd-47df-8dfd-c76f9c9bbaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b135de2c-4d78-4c4f-b631-37e25cb56ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b135de2c-4d78-4c4f-b631-37e25cb56ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414af293-3e63-4aa1-99a2-43baafb8313e', 'volume_name': 'volume-414af293-3e63-4aa1-99a2-43baafb8313e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155a7088-f01b-4c3b-b2b2-bdf90213985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155a7088-f01b-4c3b-b2b2-bdf90213985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d746d97b-d9a7-4699-9c2d-d6ddde3265ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:01:59 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Volume 414af293-3e63-4aa1-99a2-43baafb8313e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414af293-3e63-4aa1-99a2-43baafb8313e', 'volume_size': 1}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b88e237e-f72f-4f71-868d-46b7c3a8dcc2,created_at=2026-02-27T01:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2040426834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b88e237e-f72f-4f71-868d-46b7c3a8dcc2,host='devstack@QuobyteHD#QuobyteHD',id=414af293-3e63-4aa1-99a2-43baafb8313e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80ebf4e94204877b3eb245fa326ad34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:59Z,use_quota=True,user_id='c3624b98aea14563899c534896a74845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f7a55a6-4817-4347-97c5-22bf646e8725),volume_type_id=3f7a55a6-4817-4347-97c5-22bf646e8725)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Creating volume 414af293-3e63-4aa1-99a2-43baafb8313e {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:01:59 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:01:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:01:59 devstack sudo[84503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e 1073741824
Feb 27 02:01:59 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:00 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e 1073741824" returned: 0 in 0.964s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:00 devstack sudo[84521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e
Feb 27 02:02:00 devstack sudo[84521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:01 devstack sudo[84521]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e" returned: 0 in 0.630s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:02:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d746d97b-d9a7-4699-9c2d-d6ddde3265ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414af293-3e63-4aa1-99a2-43baafb8313e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185dd0af-2e2a-44ea-af17-0c3ccbab40e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:01 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Volume volume-414af293-3e63-4aa1-99a2-43baafb8313e (414af293-3e63-4aa1-99a2-43baafb8313e): created successfully
Feb 27 02:02:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185dd0af-2e2a-44ea-af17-0c3ccbab40e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Flow 'volume_create_manager' (27a4521d-b627-4b71-a5fe-37a24ddc94a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:01 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-947bc144-d8cc-47be-9d91-03187a442358 tempest-GroupsTest-676465181 None] Created volume successfully.
Feb 27 02:02:01 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4c1d2eaf-0311-4f4c-8a92-af7fc0b17df4 tempest-GroupsTest-676465181 None] Update group completed successfully.
Feb 27 02:02:03 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d526abbb-dcb8-4e0c-84ab-1c4eb02cd3d3 tempest-GroupsTest-676465181 None] Update group completed successfully.
Feb 27 02:02:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Acquiring lock "cinder-quobyte-414af293-3e63-4aa1-99a2-43baafb8313e" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Lock "cinder-quobyte-414af293-3e63-4aa1-99a2-43baafb8313e" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:04 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2324eaf0-cabc-4e70-bb66-622773838f15]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:04 devstack sudo[84534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e
Feb 27 02:02:04 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:05 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e" returned: 0 in 0.838s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:05 devstack sudo[84565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e
Feb 27 02:02:05 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:05 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-414af293-3e63-4aa1-99a2-43baafb8313e" returned: 0 in 0.692s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Lock "cinder-quobyte-414af293-3e63-4aa1-99a2-43baafb8313e" released by "delete_volume" :: held 1.576s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Acquiring lock "cinder-quobyte-6d34f809-38f7-403a-bf5f-e5f88aa52bce" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Lock "cinder-quobyte-6d34f809-38f7-403a-bf5f-e5f88aa52bce" acquired by "delete_volume" :: waited 0.025s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:06 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e21abe3-4370-431c-a4a1-576eec2cf786]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:06 devstack sudo[84570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce
Feb 27 02:02:06 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:06 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce" returned: 0 in 0.840s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:06 devstack sudo[84575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce
Feb 27 02:02:06 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:07 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6d34f809-38f7-403a-bf5f-e5f88aa52bce" returned: 0 in 0.689s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Lock "cinder-quobyte-6d34f809-38f7-403a-bf5f-e5f88aa52bce" released by "delete_volume" :: held 1.585s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Created reservations ['a02a0584-95b7-4e9e-b32b-0ff6a69fcfa7'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:07 devstack cinder-volume[83140]: WARNING cinder.quota [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-89221093 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-89221093, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:02:07 devstack cinder-volume[83140]: WARNING cinder.quota [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-89221093 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-89221093, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Created reservations ['74b9403a-2962-47dd-83cc-51171c93b431', '7f5c6755-e8a8-4b6f-9d7d-182102e5a115', '85a52742-3e8d-4486-82e4-e7bee3ace6e6', 'e0d0efab-1069-46a9-bb0a-ee181c48a011'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Created reservations ['9b4073ae-48b7-4f3e-9c06-ee00ee96b265', 'c6e66ff1-dbb0-4661-82eb-98f4f3203e56', 'bb4717da-7e8f-463a-84a5-473aefa43274', 'f673a925-9b80-4489-b23e-1162a6f1a59a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:07 devstack sudo[84578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:02:07 devstack sudo[84578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:08 devstack sudo[84578]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.901s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:08 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:02:08 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-40784e97-7730-4d86-ad04-b1a2c26d4711 tempest-GroupsTest-676465181 None] Delete group completed successfully.
Feb 27 02:02:16 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0190b3bd-4e33-4bb0-b4de-056f061587fd tempest-GroupsV320Test-835939058 None] Group tempest-GroupsV320Test-Group-1585978374: creating
Feb 27 02:02:16 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0190b3bd-4e33-4bb0-b4de-056f061587fd tempest-GroupsV320Test-835939058 None] Group tempest-GroupsV320Test-Group-1585978374: created successfully
Feb 27 02:02:16 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0190b3bd-4e33-4bb0-b4de-056f061587fd tempest-GroupsV320Test-835939058 None] Create group completed successfully.
Feb 27 02:02:17 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] Created reservations ['8475dd27-205a-40de-a37c-893872921252'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:17 devstack sudo[84660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:02:17 devstack sudo[84660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:18 devstack sudo[84660]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.500s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:18 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:02:18 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2d833856-bde9-4484-ae73-d2ff5b97bd61 tempest-GroupsV320Test-835939058 None] Delete group completed successfully.
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=104,cinder:SELECT=98,cinder:INSERT=25,cinder:DELETE=3 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=74,cinder:UPDATE=92,cinder:INSERT=15,cinder:DELETE=9 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Flow 'volume_create_manager' (7816e642-d1dd-47c8-b64b-bf2542483a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea50dd67-d0ab-48cc-b129-da9034c1f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea50dd67-d0ab-48cc-b129-da9034c1f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1385704725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14acefd6-785d-44e6-a6c7-ed517cce60db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66fb2d20a314da7beda71f2f749014c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:20Z,use_quota=True,user_id='95b273f5971747efbde065b1a7b3213d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eacbb56f-a831-4e7b-b674-a1cc6d83b7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eacbb56f-a831-4e7b-b674-a1cc6d83b7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0467ba0-4f67-4bfd-9a7b-a69380e2e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0467ba0-4f67-4bfd-9a7b-a69380e2e953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14acefd6-785d-44e6-a6c7-ed517cce60db', 'volume_name': 'volume-14acefd6-785d-44e6-a6c7-ed517cce60db', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2ac276-0e6b-4920-ad6d-09954c2042d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2ac276-0e6b-4920-ad6d-09954c2042d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2ee7c5-2edc-48e9-b3e3-7c08353d3b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:20 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Volume 14acefd6-785d-44e6-a6c7-ed517cce60db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14acefd6-785d-44e6-a6c7-ed517cce60db', 'volume_size': 1}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1385704725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14acefd6-785d-44e6-a6c7-ed517cce60db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66fb2d20a314da7beda71f2f749014c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:20Z,use_quota=True,user_id='95b273f5971747efbde065b1a7b3213d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Creating volume 14acefd6-785d-44e6-a6c7-ed517cce60db {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:02:20 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:02:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:20 devstack sudo[84664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db 1073741824
Feb 27 02:02:20 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:21 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db 1073741824" returned: 0 in 0.645s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:21 devstack sudo[84669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db
Feb 27 02:02:21 devstack sudo[84669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:21 devstack sudo[84669]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db" returned: 0 in 0.549s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:02:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2ee7c5-2edc-48e9-b3e3-7c08353d3b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14acefd6-785d-44e6-a6c7-ed517cce60db', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd237be5-ad7f-41b2-b96c-84e17a22bc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:21 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Volume volume-14acefd6-785d-44e6-a6c7-ed517cce60db (14acefd6-785d-44e6-a6c7-ed517cce60db): created successfully
Feb 27 02:02:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd237be5-ad7f-41b2-b96c-84e17a22bc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Flow 'volume_create_manager' (7816e642-d1dd-47c8-b64b-bf2542483a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:21 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-a1908f0d-a92b-4cb4-9289-41bab86ed885 tempest-AbsoluteLimitsTests-716383220 None] Created volume successfully.
Feb 27 02:02:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Acquiring lock "cinder-14acefd6-785d-44e6-a6c7-ed517cce60db-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Lock "cinder-14acefd6-785d-44e6-a6c7-ed517cce60db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Acquiring lock "cinder-quobyte-14acefd6-785d-44e6-a6c7-ed517cce60db" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Lock "cinder-quobyte-14acefd6-785d-44e6-a6c7-ed517cce60db" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:22 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31665b6-71f0-4a41-8abb-aa57bc786340]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:22 devstack sudo[84689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db
Feb 27 02:02:22 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:23 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db" returned: 0 in 0.640s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:23 devstack sudo[84694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db
Feb 27 02:02:23 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Flow 'volume_create_manager' (fb8b1659-0334-4a79-9ca6-badaa6c3c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d78a08b-00ea-4e23-ad2f-dfa42f17b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d78a08b-00ea-4e23-ad2f-dfa42f17b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-135407767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef45092-3e7e-496c-bcf1-e6963e9ed166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4222589900bf430abceb1d2c610ec8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:23Z,use_quota=True,user_id='922f20b94b7c471aaad55f24a3dd8e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d4841f-262d-4ecc-8647-3040163f0888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d4841f-262d-4ecc-8647-3040163f0888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2bd9e0a-982c-4032-920e-ee4d5c6f70e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2bd9e0a-982c-4032-920e-ee4d5c6f70e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef45092-3e7e-496c-bcf1-e6963e9ed166', 'volume_name': 'volume-aef45092-3e7e-496c-bcf1-e6963e9ed166', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a110678e-c0b9-4d22-92f7-88d1f4128cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a110678e-c0b9-4d22-92f7-88d1f4128cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de0a29b-46ea-42d8-a598-cc3d0f824258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:23 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Volume aef45092-3e7e-496c-bcf1-e6963e9ed166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef45092-3e7e-496c-bcf1-e6963e9ed166', 'volume_size': 1}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-135407767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef45092-3e7e-496c-bcf1-e6963e9ed166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4222589900bf430abceb1d2c610ec8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:23Z,use_quota=True,user_id='922f20b94b7c471aaad55f24a3dd8e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Creating volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:02:23 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:23 devstack sudo[84696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 1073741824
Feb 27 02:02:23 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:23 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14acefd6-785d-44e6-a6c7-ed517cce60db" returned: 0 in 0.531s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Lock "cinder-quobyte-14acefd6-785d-44e6-a6c7-ed517cce60db" released by "delete_volume" :: held 1.223s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Created reservations ['c70b1c1f-3efd-4878-a8e8-50de0d53c71a', '5c2b4740-b97a-492f-8351-8deca627044b', 'df0b11a0-5c26-4b7d-b6db-0f44b45062e5', '5f39819a-369d-452b-a9e9-d2ca465e3cec'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:24 devstack sudo[84703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:02:24 devstack sudo[84703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:24 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 1073741824" returned: 0 in 0.628s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:24 devstack sudo[84706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166
Feb 27 02:02:24 devstack sudo[84706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:24 devstack sudo[84703]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.450s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:02:24 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Deleted volume successfully.
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-51a46895-8a7b-4fed-bcbb-1331c684c85d tempest-AbsoluteLimitsTests-716383220 None] Lock "cinder-14acefd6-785d-44e6-a6c7-ed517cce60db-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:24 devstack sudo[84706]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166" returned: 0 in 0.487s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de0a29b-46ea-42d8-a598-cc3d0f824258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef45092-3e7e-496c-bcf1-e6963e9ed166', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54412098-a6db-49ec-9629-580f8754fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:24 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Volume volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 (aef45092-3e7e-496c-bcf1-e6963e9ed166): created successfully
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54412098-a6db-49ec-9629-580f8754fb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Flow 'volume_create_manager' (fb8b1659-0334-4a79-9ca6-badaa6c3c733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:24 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1445642b-0faf-4cf5-b273-174f1831141f tempest-SnapshotsActionsTest-1284445274 None] Created volume successfully.
Feb 27 02:02:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Creating offline snapshot 07a1f84a-33a3-4d0d-9a81-8e322631c85f of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:02:25 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3585342-fbe6-4869-b3e2-3f518162eecb]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:25 devstack sudo[84727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166
Feb 27 02:02:25 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:26 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166" returned: 0 in 0.630s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:26 devstack sudo[84732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f 1G
Feb 27 02:02:26 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:27 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f 1G" returned: 0 in 0.544s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:27 devstack sudo[84737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:02:27 devstack sudo[84737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:27 devstack sudo[84737]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.708s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:27 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f is being set with open permissions: ugo+rw
Feb 27 02:02:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:27 devstack sudo[84782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:02:27 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Flow 'volume_create_manager' (5a1756ac-c891-4c58-90e5-04c2c24f0567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab96240-2415-4484-9fb5-65ff97a3252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab96240-2415-4484-9fb5-65ff97a3252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-738123991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b4fe96-7aa5-4569-9006-cd2652fa2d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5afd8189ed4b46abaacc68e59b9da496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:28Z,use_quota=True,user_id='bdbfe824da2a4a08ba06000453526161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829d9a4d-88d5-4e56-aefe-70b9082c75ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829d9a4d-88d5-4e56-aefe-70b9082c75ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13da15d-2f6d-4ca5-9cff-683cdbeb0575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13da15d-2f6d-4ca5-9cff-683cdbeb0575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b4fe96-7aa5-4569-9006-cd2652fa2d24', 'volume_name': 'volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd720da7-bf5b-4c9b-baf7-6ee0ecd94712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd720da7-bf5b-4c9b-baf7-6ee0ecd94712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da80e6a-f3de-49d7-bbb2-0510ec33a684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:28 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Volume f7b4fe96-7aa5-4569-9006-cd2652fa2d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24', 'volume_size': 1}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:28 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.680s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:28 devstack sudo[84786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.info
Feb 27 02:02:28 devstack sudo[84786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:28 devstack sudo[84786]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.info" returned: 0 in 0.499s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:28 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.info is being set with open permissions: ugo+rw
Feb 27 02:02:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:28 devstack sudo[84808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.info
Feb 27 02:02:28 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:29 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.info" returned: 0 in 0.924s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.059s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-738123991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b4fe96-7aa5-4569-9006-cd2652fa2d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5afd8189ed4b46abaacc68e59b9da496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:28Z,use_quota=True,user_id='bdbfe824da2a4a08ba06000453526161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Creating volume f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:02:29 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:02:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:29 devstack sudo[84817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 1073741824
Feb 27 02:02:29 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:29 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-676bef20-593f-412a-bafd-7de52073e135 tempest-SnapshotsActionsTest-1284445274 None] Create snapshot completed successfully
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Flow 'volume_create_manager' (a1c656c8-1e81-4500-99ba-4e13003da432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0bf335-bac0-4163-8b7f-af29175be8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0bf335-bac0-4163-8b7f-af29175be8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-253503510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08e8d15-ffef-4a6a-a001-c5fa9a8b2006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd6ec9910734d62a835a382b0f135ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:30Z,use_quota=True,user_id='98fa4b280adf449b9320699ef34bd966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa438893-7ac5-421b-9bd1-b6faca964eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa438893-7ac5-421b-9bd1-b6faca964eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ef74b8-008a-4147-8f5d-b2fc08ae8e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ef74b8-008a-4147-8f5d-b2fc08ae8e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08e8d15-ffef-4a6a-a001-c5fa9a8b2006', 'volume_name': 'volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc33a14-1db2-4783-9f46-73fd281f0bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc33a14-1db2-4783-9f46-73fd281f0bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d51f3d-fddf-4509-b7a4-10ceb6f78245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:30 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Volume d08e8d15-ffef-4a6a-a001-c5fa9a8b2006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006', 'volume_size': 1}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:31 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 1073741824" returned: 0 in 1.207s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:31 devstack sudo[84823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24
Feb 27 02:02:31 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:31 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" returned: 0 in 0.788s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-253503510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08e8d15-ffef-4a6a-a001-c5fa9a8b2006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd6ec9910734d62a835a382b0f135ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:30Z,use_quota=True,user_id='98fa4b280adf449b9320699ef34bd966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Creating volume d08e8d15-ffef-4a6a-a001-c5fa9a8b2006 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:02:31 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da80e6a-f3de-49d7-bbb2-0510ec33a684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c5e38a-a29c-4992-b301-6a59108d2587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:31 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Volume volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 (f7b4fe96-7aa5-4569-9006-cd2652fa2d24): created successfully
Feb 27 02:02:31 devstack sudo[84836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006 1073741824
Feb 27 02:02:31 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c5e38a-a29c-4992-b301-6a59108d2587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Flow 'volume_create_manager' (5a1756ac-c891-4c58-90e5-04c2c24f0567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:32 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4d01fe22-a706-4741-9c96-5fbb6324c56c tempest-VolumesDeleteCascade-296404918 None] Created volume successfully.
Feb 27 02:02:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:02:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:32 devstack sudo[84849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:02:32 devstack sudo[84849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:32 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006 1073741824" returned: 0 in 0.845s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:32 devstack sudo[84852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006
Feb 27 02:02:32 devstack sudo[84852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:33 devstack sudo[84849]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.684s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:02:33 devstack sudo[84852]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006" returned: 0 in 0.636s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.549s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Creating offline snapshot 799abd86-707d-49a7-8f45-21f355c36e1d of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d51f3d-fddf-4509-b7a4-10ceb6f78245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b78a1c6-ecbf-4024-8cba-cd0cbbd52dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e245ace-5685-495d-a264-af57f8ac21f5]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:33 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Volume volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006 (d08e8d15-ffef-4a6a-a001-c5fa9a8b2006): created successfully
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b78a1c6-ecbf-4024-8cba-cd0cbbd52dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Flow 'volume_create_manager' (a1c656c8-1e81-4500-99ba-4e13003da432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:33 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2a5c1a6f-43e6-48ca-966c-1a34c8c107ca tempest-DeleteServersTestJSON-1608196376 None] Created volume successfully.
Feb 27 02:02:33 devstack sudo[84857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:02:33 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:34 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.564s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:34 devstack sudo[84863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d 1G
Feb 27 02:02:34 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:34 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d 1G" returned: 0 in 0.559s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:34 devstack sudo[84868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d
Feb 27 02:02:34 devstack sudo[84868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:35 devstack sudo[84868]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d" returned: 0 in 0.476s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:35 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d is being set with open permissions: ugo+rw
Feb 27 02:02:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:35 devstack sudo[84873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d
Feb 27 02:02:35 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:35 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d" returned: 0 in 0.424s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.456s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Creating offline snapshot be35b942-7ab1-4ed4-8ded-41d36a53f021 of volume f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:02:35 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-878d7fae-a6fd-492a-879c-eff30913303c tempest-SnapshotsActionsTest-1284445274 None] Create snapshot completed successfully
Feb 27 02:02:35 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be5f1f-a7f8-4a7e-9dde-7dd69d505361]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:35 devstack sudo[84880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24
Feb 27 02:02:35 devstack sudo[84880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:36 devstack sudo[84880]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" returned: 0 in 0.732s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:36 devstack sudo[84905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 1G
Feb 27 02:02:36 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-799abd86-707d-49a7-8f45-21f355c36e1d-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-799abd86-707d-49a7-8f45-21f355c36e1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-quobyte-799abd86-707d-49a7-8f45-21f355c36e1d" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-799abd86-707d-49a7-8f45-21f355c36e1d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Deleting offline snapshot 799abd86-707d-49a7-8f45-21f355c36e1d of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] snapshot_file for this snap is: volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8443b21e-5d01-47de-9991-2528b452a0c2]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:36 devstack sudo[84907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d
Feb 27 02:02:36 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-cad13f3b-8528-41d1-9f4d-9cff4840d9b7 req-e67f0f30-bc47-4e8f-967b-3f91fa6f25f0 tempest-DeleteServersTestJSON-1608196376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:37 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d" returned: 0 in 0.691s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:37 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f41f92d-270a-4d7f-a224-e6d69afeb2bf]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:37 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 1G" returned: 0 in 0.845s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:37 devstack sudo[84925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021
Feb 27 02:02:37 devstack sudo[84925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:37 devstack sudo[84924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:02:37 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:38 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.885s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:38 devstack sudo[84968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d
Feb 27 02:02:38 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:38 devstack sudo[84925]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021" returned: 0 in 1.052s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:38 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 is being set with open permissions: ugo+rw
Feb 27 02:02:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:38 devstack sudo[84970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021
Feb 27 02:02:38 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:38 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021" returned: 0 in 0.574s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:38 devstack sudo[84976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.info
Feb 27 02:02:38 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:39 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d" returned: 0 in 0.979s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:39 devstack sudo[84978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d
Feb 27 02:02:39 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:39 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.info" returned: 0 in 0.604s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:39 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.info is being set with open permissions: ugo+rw
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:39 devstack sudo[84981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.info
Feb 27 02:02:39 devstack sudo[84981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:39 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.799abd86-707d-49a7-8f45-21f355c36e1d" returned: 0 in 0.556s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-799abd86-707d-49a7-8f45-21f355c36e1d" released by "_delete_snapshot" :: held 3.192s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" released by "delete_snapshot" :: held 3.204s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:39 devstack cinder-volume[83140]: WARNING cinder.quota [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Created reservations ['3fefdc7d-04e9-47f5-a613-955dbb7e917c', '148e1b68-a955-4f04-8019-cdc58873ff1c', 'af6cafa2-2d56-42ee-af4d-6772c8c5ecbe', 'd58b5c94-0b34-494f-bfbb-09c15dacc4e3'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:39 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Delete snapshot completed successfully.
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ba3a9867-67b2-4cec-999f-055be152d34b tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-799abd86-707d-49a7-8f45-21f355c36e1d-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:39 devstack sudo[84981]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.info" returned: 0 in 0.535s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-cad13f3b-8528-41d1-9f4d-9cff4840d9b7 req-e67f0f30-bc47-4e8f-967b-3f91fa6f25f0 tempest-DeleteServersTestJSON-1608196376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.982s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:40 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ad2141dc-b875-483b-8801-010e2b15fdf9 tempest-VolumesDeleteCascade-296404918 None] Create snapshot completed successfully
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc772335-0e42-49db-bfdf-064bc86b9453]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-cad13f3b-8528-41d1-9f4d-9cff4840d9b7 req-e67f0f30-bc47-4e8f-967b-3f91fa6f25f0 tempest-DeleteServersTestJSON-1608196376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:40 devstack sudo[84985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006
Feb 27 02:02:40 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:40 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-cad13f3b-8528-41d1-9f4d-9cff4840d9b7 req-e67f0f30-bc47-4e8f-967b-3f91fa6f25f0 tempest-DeleteServersTestJSON-1608196376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006" returned: 0 in 0.585s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-cad13f3b-8528-41d1-9f4d-9cff4840d9b7 req-e67f0f30-bc47-4e8f-967b-3f91fa6f25f0 tempest-DeleteServersTestJSON-1608196376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.617s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-cad13f3b-8528-41d1-9f4d-9cff4840d9b7 req-e67f0f30-bc47-4e8f-967b-3f91fa6f25f0 tempest-DeleteServersTestJSON-1608196376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad', 'name': 'volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b221f2d-a8c0-4e06-af60-535aebbe345f', 'enforce_multipath': True} {{(pid=83140) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:40 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-cad13f3b-8528-41d1-9f4d-9cff4840d9b7 req-e67f0f30-bc47-4e8f-967b-3f91fa6f25f0 tempest-DeleteServersTestJSON-1608196376 None] attachment_update completed successfully.
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Creating offline snapshot 823da8e3-fa77-448a-95e3-2214d7c130ec of volume f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c842c4b-eb84-4693-8396-eacf338679a2]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:41 devstack sudo[84996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021
Feb 27 02:02:41 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:41 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021" returned: 0 in 0.748s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:41 devstack sudo[85007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec 1G
Feb 27 02:02:41 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:42 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec 1G" returned: 0 in 0.604s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:42 devstack sudo[85013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec
Feb 27 02:02:42 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:42 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec" returned: 0 in 0.574s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:42 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec is being set with open permissions: ugo+rw
Feb 27 02:02:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:42 devstack sudo[85019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec
Feb 27 02:02:42 devstack sudo[85019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:43 devstack sudo[85019]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec" returned: 0 in 0.441s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.094s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Creating offline snapshot 9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb9591-0d8e-4a74-a73b-fdf2785ffcad]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:43 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-77e7ab89-9435-4b56-a2cb-d5b0a71fa5df tempest-VolumesDeleteCascade-296404918 None] Create snapshot completed successfully
Feb 27 02:02:43 devstack sudo[85022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:02:43 devstack sudo[85022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-f7b4fe96-7aa5-4569-9006-cd2652fa2d24-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:43 devstack sudo[85022]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-f7b4fe96-7aa5-4569-9006-cd2652fa2d24-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.597s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:43 devstack sudo[85027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 1G
Feb 27 02:02:43 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Performing cascade delete. {{(pid=83140) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-823da8e3-fa77-448a-95e3-2214d7c130ec-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-823da8e3-fa77-448a-95e3-2214d7c130ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-823da8e3-fa77-448a-95e3-2214d7c130ec" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-823da8e3-fa77-448a-95e3-2214d7c130ec" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Deleting offline snapshot 823da8e3-fa77-448a-95e3-2214d7c130ec of volume f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] snapshot_file for this snap is: volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1080191c-a63c-409c-8f32-069f1b17ffd8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:44 devstack sudo[85029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec
Feb 27 02:02:44 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:44 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec" returned: 0 in 0.659s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[739c93e4-9067-491a-aa09-3725edc128ad]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:44 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 1G" returned: 0 in 0.816s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:44 devstack sudo[85038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3
Feb 27 02:02:44 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:44 devstack sudo[85037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021
Feb 27 02:02:44 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:45 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3" returned: 0 in 0.696s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:45 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 is being set with open permissions: ugo+rw
Feb 27 02:02:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:45 devstack sudo[85046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3
Feb 27 02:02:45 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:45 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021" returned: 0 in 0.862s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:45 devstack sudo[85049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec
Feb 27 02:02:45 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:46 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3" returned: 0 in 0.639s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.851s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:46 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8b1163aa-3d69-43dc-b966-fb584282a9f9 tempest-SnapshotsActionsTest-1284445274 None] Create snapshot completed successfully
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-quobyte-9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Deleting offline snapshot 9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] snapshot_file for this snap is: volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5f5ee8-ebcf-4ce6-9e3b-39234541447d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:46 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec" returned: 0 in 1.115s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:46 devstack sudo[85082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec
Feb 27 02:02:46 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:46 devstack sudo[85081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3
Feb 27 02:02:46 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:47 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.823da8e3-fa77-448a-95e3-2214d7c130ec" returned: 0 in 0.723s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-823da8e3-fa77-448a-95e3-2214d7c130ec" released by "_delete_snapshot" :: held 3.420s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" released by "delete_snapshot" :: held 3.432s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Created reservations ['e78bfdcf-be92-4164-9800-3d2e2f3a48e7', 'dceedc5f-2e20-4080-9dee-32cbc13904a8', 'd8760810-5f48-4ca7-b5c5-9231e7b897ae', '0996bd0a-705a-4db0-aee2-1b9e7217539b'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:47 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3" returned: 0 in 0.890s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[936f9a49-12a5-4c4d-b460-a781d12479a9]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Delete snapshot completed successfully.
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-823da8e3-fa77-448a-95e3-2214d7c130ec-delete_snapshot" released by "delete_snapshot" :: held 3.631s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-be35b942-7ab1-4ed4-8ded-41d36a53f021-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-be35b942-7ab1-4ed4-8ded-41d36a53f021-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-be35b942-7ab1-4ed4-8ded-41d36a53f021" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-be35b942-7ab1-4ed4-8ded-41d36a53f021" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Deleting offline snapshot be35b942-7ab1-4ed4-8ded-41d36a53f021 of volume f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] snapshot_file for this snap is: volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb554452-1569-4e62-97c7-239739cef552]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:47 devstack sudo[85089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:02:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:47 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:47 devstack sudo[85092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021
Feb 27 02:02:47 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Flow 'volume_create_manager' (c25cf131-2752-4df4-97a0-726a69a56c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059d831d-6415-4607-9be5-83f508845fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059d831d-6415-4607-9be5-83f508845fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:48Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb87f157-c32c-4174-96ee-7c935cfd3783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5957d0a5c9bf4b23918b1b0de97fdd4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:48Z,use_quota=True,user_id='1382e87c3b01444d85a23765bfadb926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bad482-e3f4-44b8-a272-fb669788822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bad482-e3f4-44b8-a272-fb669788822a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286bdcbf-b3f4-47b6-b092-7834fa80d875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.image.glance [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Creating Keystone auth plugin from conf {{(pid=83140) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 02:02:48 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021" returned: 0 in 0.809s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5b8b85-6758-4d3e-9ff1-cb527e07fcc7]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:48 devstack sudo[85099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24
Feb 27 02:02:48 devstack sudo[85099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:48 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286bdcbf-b3f4-47b6-b092-7834fa80d875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb87f157-c32c-4174-96ee-7c935cfd3783', 'volume_name': 'volume-cb87f157-c32c-4174-96ee-7c935cfd3783', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7591dbe7a0>}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0b2694-a309-459c-a3fc-31f619e97214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0b2694-a309-459c-a3fc-31f619e97214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325c0e20-1f15-4734-bbc7-37cff8ca5c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:48 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Volume cb87f157-c32c-4174-96ee-7c935cfd3783: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb87f157-c32c-4174-96ee-7c935cfd3783', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7591dbe7a0>}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Trying to clone cb87f157-c32c-4174-96ee-7c935cfd3783 from image 6dca12c4-e54e-4172-8642-cefd07ec0f99 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]). {{(pid=83140) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 1.212s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:48 devstack sudo[85104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3
Feb 27 02:02:48 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:49 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-c07a8513-f2d0-4cbc-b8fd-16f0ed447374 req-c88cb122-6967-46dc-bda7-51ed629274c0 tempest-DeleteServersTestJSON-1608196376 None] Terminate volume connection completed successfully.
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-c07a8513-f2d0-4cbc-b8fd-16f0ed447374 req-c88cb122-6967-46dc-bda7-51ed629274c0 tempest-DeleteServersTestJSON-1608196376 None] Deleting attachment 8b221f2d-a8c0-4e06-af60-535aebbe345f. {{(pid=83140) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 02:02:49 devstack cinder-volume[83140]: INFO cinder.image.image_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fad624-6421-4526-b8f7-bf6c8631f287]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:49 devstack sudo[85132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD
Feb 27 02:02:49 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:49 devstack sudo[85099]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" returned: 0 in 0.742s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:49 devstack sudo[85135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021
Feb 27 02:02:49 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:49 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3" returned: 0 in 0.579s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:49 devstack sudo[85137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3
Feb 27 02:02:49 devstack sudo[85137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:49 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Temporary image 6dca12c4-e54e-4172-8642-cefd07ec0f99 is fetched for user 1382e87c3b01444d85a23765bfadb926. {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c3aa26-52aa-4137-9029-5b704b7b1104]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:49 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021" returned: 0 in 0.700s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:50 devstack sudo[85146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021
Feb 27 02:02:50 devstack sudo[85146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:50 devstack sudo[85145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD
Feb 27 02:02:50 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:50 devstack sudo[85137]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3" returned: 0 in 0.793s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3" released by "_delete_snapshot" :: held 3.578s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" released by "delete_snapshot" :: held 3.605s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Created reservations ['7e448092-90d9-43a2-a61f-16e0da208e69', '9869b631-e8b3-4f97-9fd7-195abd9749b1', '6add4599-41b5-48b4-aa36-caff27fc89a6', '7f9ace98-fdd1-4cc1-862e-7b000d3450cb'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:50 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Delete snapshot completed successfully.
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7efd2f1f-808c-4042-9273-b53a71013038 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-9c8ad7a4-cc7d-4cd7-bd2d-f3c3c4bc40d3-delete_snapshot" released by "delete_snapshot" :: held 3.810s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:50 devstack sudo[85146]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24.be35b942-7ab1-4ed4-8ded-41d36a53f021" returned: 0 in 0.621s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:50 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:48Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb87f157-c32c-4174-96ee-7c935cfd3783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5957d0a5c9bf4b23918b1b0de97fdd4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:48Z,use_quota=True,user_id='1382e87c3b01444d85a23765bfadb926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Creating volume cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:02:50 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-be35b942-7ab1-4ed4-8ded-41d36a53f021" released by "_delete_snapshot" :: held 2.947s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" released by "delete_snapshot" :: held 2.974s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:50 devstack sudo[85154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 1073741824
Feb 27 02:02:50 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Created reservations ['dd984999-ba5d-4f69-ac44-07a2065160fc', '06c30eff-917b-4bcf-ae7e-e8dfcc593429', '15e823bb-08a5-4a67-b502-cf1d53061d39', '7ce6242d-dd43-4456-9446-fe17bb41e226'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:50 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Delete snapshot completed successfully.
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-be35b942-7ab1-4ed4-8ded-41d36a53f021-delete_snapshot" released by "delete_snapshot" :: held 3.100s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Snapshots deleted, issuing volume delete {{(pid=83140) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f198db73-edbb-4d60-948d-d7fe442b7c2e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:50 devstack sudo[85156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24
Feb 27 02:02:50 devstack sudo[85156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:51 devstack sudo[85156]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" returned: 0 in 0.670s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:51 devstack sudo[85164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24
Feb 27 02:02:51 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:51 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 1073741824" returned: 0 in 0.918s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:51 devstack sudo[85167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783
Feb 27 02:02:51 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:51 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" returned: 0 in 0.535s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-f7b4fe96-7aa5-4569-9006-cd2652fa2d24" released by "delete_volume" :: held 1.245s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Created reservations ['2d3bc1df-3fc0-434c-9233-afa0158a9eea', 'd946342f-352c-49b1-ac2a-fa61f22300a0', 'ce9f717a-d3fe-4469-8d05-bfeb6ac497bd', '442f8538-27f9-4c1d-9289-0e2962f2f69a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:52 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783" returned: 0 in 0.500s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.042s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:52 devstack sudo[85171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:02:52 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Creating offline snapshot 8c9d992f-8f60-4508-b4d2-88b0db8fcad3 of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Attempting download of 6dca12c4-e54e-4172-8642-cefd07ec0f99 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}])) to volume cb87f157-c32c-4174-96ee-7c935cfd3783. {{(pid=83140) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e2a7f-5ef9-434c-8e5c-9a269f5263f7]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c06cb-b362-470c-ae7f-448862912c09]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_1gz9li4j {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:52 devstack sudo[85173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:02:52 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:52 devstack sudo[85174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_1gz9li4j
Feb 27 02:02:52 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:52 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.537s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:02:52 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Deleted volume successfully.
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3f29a76b-1a8d-4c3e-80ec-825e01bc813b tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-f7b4fe96-7aa5-4569-9006-cd2652fa2d24-delete_volume" released by "delete_volume" :: held 8.757s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:52 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_1gz9li4j" returned: 0 in 0.658s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_1gz9li4j {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:52 devstack sudo[85182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_1gz9li4j
Feb 27 02:02:52 devstack sudo[85182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Acquiring lock "cinder-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Lock "cinder-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Acquiring lock "cinder-quobyte-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Lock "cinder-quobyte-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:53 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.977s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53fe40e-19b1-41e1-819b-0eb0a1a1e25e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:53 devstack sudo[85187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 1G
Feb 27 02:02:53 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:53 devstack sudo[85188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006
Feb 27 02:02:53 devstack sudo[85188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Flow 'volume_create_manager' (8a7a5147-a0b7-4634-a238-46cd18a70188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1464dcca-8058-4023-9f5e-9f96089fa216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1464dcca-8058-4023-9f5e-9f96089fa216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1516010212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11977c2c-3a4f-4e1d-af0b-11d4d2e53a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5afd8189ed4b46abaacc68e59b9da496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:53Z,use_quota=True,user_id='bdbfe824da2a4a08ba06000453526161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44bd0a9-abf8-447c-9129-9dbe703e18f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44bd0a9-abf8-447c-9129-9dbe703e18f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b86429-875d-4374-9246-e732ac54b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b86429-875d-4374-9246-e732ac54b829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11977c2c-3a4f-4e1d-af0b-11d4d2e53a65', 'volume_name': 'volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bc5b0f-cb1b-41c8-9f12-9ddd9e1a1c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bc5b0f-cb1b-41c8-9f12-9ddd9e1a1c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6564bfd1-0bf0-4c08-9a59-117d8a160eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:53 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Volume 11977c2c-3a4f-4e1d-af0b-11d4d2e53a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65', 'volume_size': 1}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:53 devstack sudo[85182]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_1gz9li4j" returned: 1 in 0.751s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_1gz9li4j' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3e737a-5112-4d10-b65d-a4e816086cf1]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:53 devstack sudo[85196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD
Feb 27 02:02:53 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:53 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 1G" returned: 0 in 0.574s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:53 devstack sudo[85198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3
Feb 27 02:02:53 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:53 devstack sudo[85188]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006" returned: 0 in 0.713s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:53 devstack sudo[85203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006
Feb 27 02:02:53 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:54 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD" returned: 0 in 0.562s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] 6dca12c4-e54e-4172-8642-cefd07ec0f99 was qcow2, converting to raw {{(pid=83140) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:54 devstack sudo[85208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783
Feb 27 02:02:54 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:54 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006" returned: 0 in 0.451s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Lock "cinder-quobyte-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006" released by "delete_volume" :: held 1.215s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:54 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3" returned: 0 in 0.654s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:54 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 is being set with open permissions: ugo+rw
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Created reservations ['1f53e794-39f8-469f-b175-85e86e24bed3', 'b708ab81-494c-4ee4-b244-61848ba0f5a2', '6c9a810b-6e22-4d45-9201-7a35038c2397', '81feb0d7-3640-467f-84d9-8b889784eb3f'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:54 devstack sudo[85214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3
Feb 27 02:02:54 devstack sudo[85214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:54 devstack sudo[85217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:02:54 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:54 devstack sudo[85214]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3" returned: 0 in 0.426s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.385s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1516010212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11977c2c-3a4f-4e1d-af0b-11d4d2e53a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5afd8189ed4b46abaacc68e59b9da496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:53Z,use_quota=True,user_id='bdbfe824da2a4a08ba06000453526161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Creating volume 11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:02:54 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:54 devstack sudo[85226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 1073741824
Feb 27 02:02:54 devstack sudo[85226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:54 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-034a4987-fcb3-4555-bb53-d44287248555 tempest-SnapshotsActionsTest-1284445274 None] Create snapshot completed successfully
Feb 27 02:02:54 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.496s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:02:54 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Deleted volume successfully.
Feb 27 02:02:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d0b0caf-ed98-4d60-8322-288d115aefe5 tempest-DeleteServersTestJSON-1608196376 None] Lock "cinder-d08e8d15-ffef-4a6a-a001-c5fa9a8b2006-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:55 devstack sudo[85226]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 1073741824" returned: 0 in 0.649s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-8c9d992f-8f60-4508-b4d2-88b0db8fcad3-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:55 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783" returned: 0 in 1.358s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_yp5vfm9ldevstack@QuobyteHD, size 112.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:02:55 devstack cinder-volume[83140]: INFO cinder.image.image_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Converted 112.00 MB image at 81.90 MB/s
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:55 devstack sudo[85234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65
Feb 27 02:02:55 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-8c9d992f-8f60-4508-b4d2-88b0db8fcad3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-quobyte-8c9d992f-8f60-4508-b4d2-88b0db8fcad3" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:02:55 devstack sudo[85235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 1G
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-8c9d992f-8f60-4508-b4d2-88b0db8fcad3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:02:55 devstack sudo[85235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Deleting offline snapshot 8c9d992f-8f60-4508-b4d2-88b0db8fcad3 of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] snapshot_file for this snap is: volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba8651d-3d6a-40cb-a4f2-ce8cf1ab4743]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:55 devstack sudo[85238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3
Feb 27 02:02:55 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:56 devstack sudo[85235]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 1G" returned: 0 in 0.559s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ade859-3154-4d7c-8fbf-6091395d3fe3]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:56 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" returned: 0 in 0.621s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6564bfd1-0bf0-4c08-9a59-117d8a160eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2814afd-0938-444c-8417-d80bf50e788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Volume volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 (11977c2c-3a4f-4e1d-af0b-11d4d2e53a65): created successfully
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2814afd-0938-444c-8417-d80bf50e788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Flow 'volume_create_manager' (8a7a5147-a0b7-4634-a238-46cd18a70188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:56 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0941eac1-5b08-4f7d-bcb8-bc37414a62d9 tempest-VolumesDeleteCascade-296404918 None] Created volume successfully.
Feb 27 02:02:56 devstack sudo[85275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783
Feb 27 02:02:56 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:56 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3" returned: 0 in 0.968s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bad7fb8-a152-43f7-b5b9-4f29ab24540d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:56 devstack sudo[85280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:02:56 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Creating offline snapshot 97a5b600-514c-46cc-8515-865d57122c2b of volume 11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb5f621-9d76-45f7-ab63-8c1c20ced25a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:56 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783" returned: 0 in 0.778s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:57 devstack sudo[85287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783
Feb 27 02:02:57 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:57 devstack sudo[85286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65
Feb 27 02:02:57 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:57 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.819s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:57 devstack sudo[85294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3
Feb 27 02:02:57 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:57 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" returned: 0 in 0.780s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:57 devstack sudo[85299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b 1G
Feb 27 02:02:57 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:57 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783" returned: 1 in 0.898s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Downloaded image 6dca12c4-e54e-4172-8642-cefd07ec0f99 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}])) to volume cb87f157-c32c-4174-96ee-7c935cfd3783 successfully. {{(pid=83140) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Temporary image 6dca12c4-e54e-4172-8642-cefd07ec0f99 for user 1382e87c3b01444d85a23765bfadb926 is deleted. {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Marking volume cb87f157-c32c-4174-96ee-7c935cfd3783 as bootable. {{(pid=83140) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Copying metadata from image 6dca12c4-e54e-4172-8642-cefd07ec0f99 to cb87f157-c32c-4174-96ee-7c935cfd3783. {{(pid=83140) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Creating volume glance metadata for volume cb87f157-c32c-4174-96ee-7c935cfd3783 backed by image 6dca12c4-e54e-4172-8642-cefd07ec0f99 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83140) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325c0e20-1f15-4734-bbc7-37cff8ca5c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb87f157-c32c-4174-96ee-7c935cfd3783', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7591dbe7a0>}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0713f579-d6b9-45f8-b3c7-e41948992982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:02:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Volume volume-cb87f157-c32c-4174-96ee-7c935cfd3783 (cb87f157-c32c-4174-96ee-7c935cfd3783): created successfully
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0713f579-d6b9-45f8-b3c7-e41948992982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:02:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Flow 'volume_create_manager' (c25cf131-2752-4df4-97a0-726a69a56c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:02:58 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-93ef2283-c998-4c15-b25a-f37db172734a tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Created volume successfully.
Feb 27 02:02:58 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3" returned: 0 in 0.954s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:58 devstack sudo[85310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3
Feb 27 02:02:58 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:58 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b 1G" returned: 0 in 0.778s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:58 devstack sudo[85312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b
Feb 27 02:02:58 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:59 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b" returned: 0 in 0.578s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:59 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b is being set with open permissions: ugo+rw
Feb 27 02:02:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:59 devstack sudo[85318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b
Feb 27 02:02:59 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.8c9d992f-8f60-4508-b4d2-88b0db8fcad3" returned: 0 in 0.639s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:59 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:02:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-8c9d992f-8f60-4508-b4d2-88b0db8fcad3" released by "_delete_snapshot" :: held 3.451s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" released by "delete_snapshot" :: held 3.469s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:59 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Created reservations ['5b3d0ba4-2460-49fa-b9aa-b60ebd6e5a8b', '272900a7-64c6-4e42-84fd-16a82117abac', '422a0bd9-138d-44e2-9697-d18351d5a2ff', 'f4d74c63-c018-4e98-8611-87eea755f653'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:02:59 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Delete snapshot completed successfully.
Feb 27 02:02:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bc800410-5663-41dd-9e9a-bdb7b34c3dfa tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-8c9d992f-8f60-4508-b4d2-88b0db8fcad3-delete_snapshot" released by "delete_snapshot" :: held 3.620s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:02:59 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root
Feb 27 02:02:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b" returned: 0 in 0.664s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:02:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:02:59 devstack sudo[85322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.info
Feb 27 02:02:59 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:00 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.info" returned: 0 in 0.530s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:00 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.info is being set with open permissions: ugo+rw
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:00 devstack sudo[85325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.info
Feb 27 02:03:00 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:00 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.info" returned: 0 in 0.617s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.036s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.829s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:00 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-da4e9b62-ac3e-41d7-b8bf-7793c815e484 tempest-VolumesDeleteCascade-296404918 None] Create snapshot completed successfully
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Creating offline snapshot 3681500a-ff27-455b-8102-1d46cf0453d8 of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3829251-c906-4187-98da-95847b48af9d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:01 devstack sudo[85336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:03:01 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Flow 'volume_create_manager' (3899725e-56a1-4a5f-84c7-9956b636dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54111ddf-39a8-4353-b552-b99265a59759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54111ddf-39a8-4353-b552-b99265a59759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1889100172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1075ab89-a8d3-4dd2-b2cd-f025bb4463a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5afd8189ed4b46abaacc68e59b9da496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97a5b600-514c-46cc-8515-865d57122c2b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:01Z,use_quota=True,user_id='bdbfe824da2a4a08ba06000453526161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfe8690-04ca-4296-8798-008f4d233577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfe8690-04ca-4296-8798-008f4d233577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c55c879-1747-4852-a80b-647547ed1ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c55c879-1747-4852-a80b-647547ed1ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1075ab89-a8d3-4dd2-b2cd-f025bb4463a8', 'volume_name': 'volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8', 'volume_size': 1, 'snapshot_id': '97a5b600-514c-46cc-8515-865d57122c2b'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013c1ce7-7666-4c89-8073-7135b129c76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013c1ce7-7666-4c89-8073-7135b129c76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecc0eff-e08a-4083-9e41-1d7eda6dca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:01 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Volume 1075ab89-a8d3-4dd2-b2cd-f025bb4463a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8', 'volume_size': 1, 'snapshot_id': '97a5b600-514c-46cc-8515-865d57122c2b'}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:01 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.649s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:03:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:01 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 1G
Feb 27 02:03:01 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:02 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 1G" returned: 0 in 0.639s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:02 devstack sudo[85346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8
Feb 27 02:03:02 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:02 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8" returned: 0 in 0.518s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:02 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 is being set with open permissions: ugo+rw
Feb 27 02:03:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:02 devstack sudo[85352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8
Feb 27 02:03:02 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:03 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8" returned: 0 in 0.539s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.555s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:03 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-90460818-6293-449b-a801-7ec89b27efa1 tempest-SnapshotsActionsTest-1284445274 None] Create snapshot completed successfully
Feb 27 02:03:03 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17e76b7-71fd-484e-bc29-059e5f25307d]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:03 devstack sudo[85355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783
Feb 27 02:03:03 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:04 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783" returned: 0 in 0.721s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:04 devstack sudo[85359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783
Feb 27 02:03:04 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-3681500a-ff27-455b-8102-1d46cf0453d8-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-3681500a-ff27-455b-8102-1d46cf0453d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Acquiring lock "cinder-quobyte-3681500a-ff27-455b-8102-1d46cf0453d8" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-3681500a-ff27-455b-8102-1d46cf0453d8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Deleting offline snapshot 3681500a-ff27-455b-8102-1d46cf0453d8 of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] snapshot_file for this snap is: volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[117d8727-c55d-473e-9ec2-a991ab5cee48]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:04 devstack sudo[85362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8
Feb 27 02:03:04 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:04 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783" returned: 1 in 0.671s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.448s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.325s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-97a5b600-514c-46cc-8515-865d57122c2b-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" by "_create_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-97a5b600-514c-46cc-8515-865d57122c2b-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Creating volume 1075ab89-a8d3-4dd2-b2cd-f025bb4463a8 from snapshot 97a5b600-514c-46cc-8515-865d57122c2b {{(pid=83140) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] snapshot: 97a5b600-514c-46cc-8515-865d57122c2b, volume: 1075ab89-a8d3-4dd2-b2cd-f025bb4463a8,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad', 'name': 'volume-cb87f157-c32c-4174-96ee-7c935cfd3783', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e091323-f2d4-4ea8-be19-69fdfaece54a', 'enforce_multipath': True} {{(pid=83140) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ad6bb7-8f02-4530-bc75-a2c7ed80d920]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:04 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-a95af637-beb1-4183-a97e-173b1ebbe0ad req-5ad0bea3-266e-4d55-97f6-c02e6ab097af tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] attachment_update completed successfully.
Feb 27 02:03:05 devstack sudo[85366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b
Feb 27 02:03:05 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:05 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8" returned: 0 in 0.859s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31a6220-0adf-4d46-8773-a795f59ecbf1]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:05 devstack sudo[85371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:03:05 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:05 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b" returned: 0 in 1.047s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1957d587-0476-457b-94bf-49d1c89091b7]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:06 devstack sudo[85376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65
Feb 27 02:03:06 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:06 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.865s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:03:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:06 devstack sudo[85381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8
Feb 27 02:03:06 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:06 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" returned: 0 in 0.978s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:06 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:03:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:06 devstack sudo[85386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8
Feb 27 02:03:06 devstack sudo[85386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:07 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8" returned: 0 in 1.000s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:07 devstack sudo[85391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8
Feb 27 02:03:07 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:08 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.3681500a-ff27-455b-8102-1d46cf0453d8" returned: 0 in 1.374s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-3681500a-ff27-455b-8102-1d46cf0453d8" released by "_delete_snapshot" :: held 4.188s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" released by "delete_snapshot" :: held 4.212s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:09 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Created reservations ['0d2bfcb2-8c29-42c5-8fcf-cea61ee9ff06', '7c2d4968-60aa-4238-87bf-cf2b9d93f6da', '3a12e9dc-79e8-41e6-8a6b-989717716aa8', 'd238041e-7ad5-45d4-bcb3-9bcb50db2634'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:09 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Delete snapshot completed successfully.
Feb 27 02:03:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6b2a6b5c-1112-42a4-ab7a-1cfaf2f3b1c9 tempest-SnapshotsActionsTest-1013283014 None] Lock "cinder-3681500a-ff27-455b-8102-1d46cf0453d8-delete_snapshot" released by "delete_snapshot" :: held 4.661s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:10 devstack sudo[85386]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" returned: 0 in 3.268s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ee0411-8794-4c70-ade5-5cade7f7b13c]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:10 devstack sudo[85445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65
Feb 27 02:03:10 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "cinder-07a1f84a-33a3-4d0d-9a81-8e322631c85f-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-07a1f84a-33a3-4d0d-9a81-8e322631c85f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "cinder-quobyte-07a1f84a-33a3-4d0d-9a81-8e322631c85f" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-quobyte-07a1f84a-33a3-4d0d-9a81-8e322631c85f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Deleting offline snapshot 07a1f84a-33a3-4d0d-9a81-8e322631c85f of volume aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] snapshot_file for this snap is: volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6076d0-8691-465f-86a7-0a311a82298a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:10 devstack sudo[85447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:03:10 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:11 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" returned: 0 in 0.928s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65, size 1024.00 MB, duration 3.27 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:03:11 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Converted 1024.00 MB image at 313.31 MB/s
Feb 27 02:03:11 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8 is being set with open permissions: ugo+rw
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:11 devstack sudo[85452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8
Feb 27 02:03:11 devstack sudo[85452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:11 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.569s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef45092-3e7e-496c-bcf1-e6963e9ed166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[52010bd2-0523-4ace-a14e-acad0b9aae06]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:11 devstack sudo[85457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166
Feb 27 02:03:11 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:11 devstack sudo[85452]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" returned: 0 in 0.465s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" released by "_copy_volume_from_snapshot" :: held 6.795s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-97a5b600-514c-46cc-8515-865d57122c2b-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" released by "_create_volume_from_snapshot" :: held 6.820s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.834s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecc0eff-e08a-4083-9e41-1d7eda6dca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8', 'volume_size': 1, 'snapshot_id': '97a5b600-514c-46cc-8515-865d57122c2b'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a834e82-89f6-4b7b-8d46-ca171bb33d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:11 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Volume volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8 (1075ab89-a8d3-4dd2-b2cd-f025bb4463a8): created successfully
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a834e82-89f6-4b7b-8d46-ca171bb33d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Flow 'volume_create_manager' (3899725e-56a1-4a5f-84c7-9956b636dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:11 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-53a9cbad-f849-4aa5-a32b-165e217f555a tempest-VolumesDeleteCascade-296404918 None] Created volume successfully.
Feb 27 02:03:11 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166" returned: 0 in 0.542s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:11 devstack sudo[85463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:03:11 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:12 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.563s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:12 devstack sudo[85471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f
Feb 27 02:03:12 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Performing cascade delete. {{(pid=83140) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-97a5b600-514c-46cc-8515-865d57122c2b-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-97a5b600-514c-46cc-8515-865d57122c2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-97a5b600-514c-46cc-8515-865d57122c2b" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-97a5b600-514c-46cc-8515-865d57122c2b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Deleting offline snapshot 97a5b600-514c-46cc-8515-865d57122c2b of volume 11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] snapshot_file for this snap is: volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a33f239-504b-4765-82ef-3d4686267e65]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:12 devstack sudo[85476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b
Feb 27 02:03:12 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:13 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166.07a1f84a-33a3-4d0d-9a81-8e322631c85f" returned: 0 in 0.567s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-quobyte-07a1f84a-33a3-4d0d-9a81-8e322631c85f" released by "_delete_snapshot" :: held 2.326s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" released by "delete_snapshot" :: held 2.358s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Created reservations ['d30e496c-25f2-4204-b110-1aaa881b9217', '6fcea939-fef8-4327-b6c1-f59245b4b7c5', 'bc71a72e-2fd0-40bc-b8ce-547076f6ab1e', 'cb731205-4bb5-4ad0-ba1b-08d624a9c5fe'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:13 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Delete snapshot completed successfully.
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d440acd-9eef-4980-80be-b100b967a718 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-07a1f84a-33a3-4d0d-9a81-8e322631c85f-delete_snapshot" released by "delete_snapshot" :: held 2.466s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:13 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b" returned: 0 in 0.723s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb6d4aa-e5f6-40fa-899e-44aac7d92ca9]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:13 devstack sudo[85483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65
Feb 27 02:03:13 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "cinder-aef45092-3e7e-496c-bcf1-e6963e9ed166-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-aef45092-3e7e-496c-bcf1-e6963e9ed166-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6b1baf-f495-4572-9fcf-cd24acaad750]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:14 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" returned: 0 in 0.626s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:14 devstack sudo[85489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b
Feb 27 02:03:14 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:14 devstack sudo[85488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166
Feb 27 02:03:14 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:14 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b" returned: 0 in 0.487s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:14 devstack sudo[85498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b
Feb 27 02:03:14 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:14 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166" returned: 0 in 0.551s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:14 devstack sudo[85500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166
Feb 27 02:03:14 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:15 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65.97a5b600-514c-46cc-8515-865d57122c2b" returned: 0 in 0.445s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-97a5b600-514c-46cc-8515-865d57122c2b" released by "_delete_snapshot" :: held 2.331s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" released by "delete_snapshot" :: held 2.344s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Created reservations ['0adf4a11-8459-4678-83b3-f66fadf5a05c', '99b38443-93a7-449c-8b74-5bddc1a3bb33', '951e1346-ba7e-4bc1-a216-9cb8120b7bb1', 'c8fbd0fc-fab1-4558-a6a1-b5ea9000f636'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:15 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Delete snapshot completed successfully.
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-97a5b600-514c-46cc-8515-865d57122c2b-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Snapshots deleted, issuing volume delete {{(pid=83140) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:15 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aef45092-3e7e-496c-bcf1-e6963e9ed166" returned: 0 in 0.527s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c17d47-389e-44bd-86b3-ac31e4d4ff9c]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-quobyte-aef45092-3e7e-496c-bcf1-e6963e9ed166" released by "delete_volume" :: held 1.116s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Created reservations ['74246d6e-2f0e-4e0b-aacf-fec56ed454cb', 'b4fb3f5c-4bcf-493a-b4cc-3600e17d68d7', '156bd894-c924-427b-a856-a4c10c9c62fa', '6dbc4712-79c1-413c-b0a9-fa0ccdb8e0c6'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:15 devstack sudo[85504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65
Feb 27 02:03:15 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:15 devstack sudo[85506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:15 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:15 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" returned: 0 in 0.534s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:15 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.460s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:15 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Deleted volume successfully.
Feb 27 02:03:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1e10bf2e-7d6d-43e0-a07e-2e54870003d6 tempest-SnapshotsActionsTest-1284445274 None] Lock "cinder-aef45092-3e7e-496c-bcf1-e6963e9ed166-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:15 devstack sudo[85513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65
Feb 27 02:03:15 devstack sudo[85513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:16 devstack sudo[85513]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" returned: 0 in 0.925s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65" released by "delete_volume" :: held 1.506s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:16 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Created reservations ['b25c09c8-ee2d-4481-a21d-3197903030a3', '4a96e546-334a-4747-97af-7619f6440ede', '1a3067c3-81df-4c57-a8cd-84e016b1606f', '93868cee-f7ad-4ed5-82ad-255c55baa51a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:16 devstack sudo[85517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:16 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "cinder-quobyte-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:17 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5434d8ea-f0db-4899-b51e-b659c05194b9]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:17 devstack sudo[85520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8
Feb 27 02:03:17 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:18 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.490s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:18 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:18 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Deleted volume successfully.
Feb 27 02:03:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a477f2c-2287-4853-a1a5-6aa3c3fa72f5 tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-11977c2c-3a4f-4e1d-af0b-11d4d2e53a65-delete_volume" released by "delete_volume" :: held 5.701s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:18 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" returned: 0 in 1.236s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:18 devstack sudo[85527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8
Feb 27 02:03:18 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:19 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" returned: 0 in 0.853s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-quobyte-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8" released by "delete_volume" :: held 2.127s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:19 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Created reservations ['027e12d8-b7e6-48c6-876f-ecd85c775ee9', '370f74b0-69c4-43c7-a4c9-0bd24713fe65', '2fe787d7-e2fb-40bf-b48d-314fdbfb03ca', '84033c2d-6b4a-49cc-a33a-66e8f630134d'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:19 devstack sudo[85544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:19 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:20 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.758s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:20 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:20 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Deleted volume successfully.
Feb 27 02:03:20 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=144,cinder:UPDATE=115,cinder:INSERT=42,cinder:DELETE=11 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:03:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cc2837b0-5a74-4014-b522-a5211025cd8a tempest-VolumesDeleteCascade-296404918 None] Lock "cinder-1075ab89-a8d3-4dd2-b2cd-f025bb4463a8-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=137,cinder:INSERT=36,cinder:DELETE=10,cinder:SELECT=110 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Flow 'volume_create_manager' (348873be-5470-46a7-85af-2ba9dbcafcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d26018-9ac2-4722-ba35-44a9c632c2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d26018-9ac2-4722-ba35-44a9c632c2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1099684040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb404c74-f59d-40f7-922f-f2b41453460b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a185f97bfbd404bbaa822ae786fddec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:24Z,use_quota=True,user_id='63f8755a558f40f3b65fed015f391ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169f008d-8ee1-4d80-abc0-56c046f55b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169f008d-8ee1-4d80-abc0-56c046f55b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee1a884-e652-4380-9d28-24bd2020b42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee1a884-e652-4380-9d28-24bd2020b42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb404c74-f59d-40f7-922f-f2b41453460b', 'volume_name': 'volume-eb404c74-f59d-40f7-922f-f2b41453460b', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012c3e87-f599-45c8-b504-98d9db2e377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012c3e87-f599-45c8-b504-98d9db2e377b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f0756a-fbc8-43f7-a8df-62b275bbc130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:24 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Volume eb404c74-f59d-40f7-922f-f2b41453460b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb404c74-f59d-40f7-922f-f2b41453460b', 'volume_size': 1}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1099684040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb404c74-f59d-40f7-922f-f2b41453460b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a185f97bfbd404bbaa822ae786fddec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:24Z,use_quota=True,user_id='63f8755a558f40f3b65fed015f391ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Creating volume eb404c74-f59d-40f7-922f-f2b41453460b {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:03:24 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:03:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:24 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b 1073741824
Feb 27 02:03:24 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:25 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b 1073741824" returned: 0 in 0.768s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:25 devstack sudo[85602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b
Feb 27 02:03:25 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:25 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b" returned: 0 in 0.546s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:03:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f0756a-fbc8-43f7-a8df-62b275bbc130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb404c74-f59d-40f7-922f-f2b41453460b', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2053931f-6351-43b3-a3ce-3c2b3346eb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:26 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Volume volume-eb404c74-f59d-40f7-922f-f2b41453460b (eb404c74-f59d-40f7-922f-f2b41453460b): created successfully
Feb 27 02:03:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2053931f-6351-43b3-a3ce-3c2b3346eb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Flow 'volume_create_manager' (348873be-5470-46a7-85af-2ba9dbcafcf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:26 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ee9a9de1-f948-49f7-b4c9-d676df7ea64c tempest-VolumesMetadataTest-880653091 None] Created volume successfully.
Feb 27 02:03:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Acquiring lock "cinder-eb404c74-f59d-40f7-922f-f2b41453460b-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Lock "cinder-eb404c74-f59d-40f7-922f-f2b41453460b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Acquiring lock "cinder-quobyte-eb404c74-f59d-40f7-922f-f2b41453460b" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Lock "cinder-quobyte-eb404c74-f59d-40f7-922f-f2b41453460b" acquired by "delete_volume" :: waited 0.022s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:28 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b99270e-12c0-4fc1-b62a-69e6e04b6662]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:28 devstack sudo[85695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b
Feb 27 02:03:28 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:28 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b" returned: 0 in 0.610s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:28 devstack sudo[85701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b
Feb 27 02:03:28 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:29 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-eb404c74-f59d-40f7-922f-f2b41453460b" returned: 0 in 0.584s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Lock "cinder-quobyte-eb404c74-f59d-40f7-922f-f2b41453460b" released by "delete_volume" :: held 1.255s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:29 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Created reservations ['1df6be58-6286-41af-b6fc-b96b9d249c2e', '6ea2b375-f1cc-4727-91c3-ca8366e18b7b', 'b36057f4-00c2-4356-bc73-641df2ecfac8', '9eca6848-4088-47da-930d-a87bf05b46fe'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:29 devstack sudo[85704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:29 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:30 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.633s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:30 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:30 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Deleted volume successfully.
Feb 27 02:03:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dd168a26-d8bb-4cb5-b656-8f5737705138 tempest-VolumesMetadataTest-880653091 None] Lock "cinder-eb404c74-f59d-40f7-922f-f2b41453460b-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:03:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:32 devstack sudo[85733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:32 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:35 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 2.485s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:35 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Flow 'volume_create_manager' (1c9895d4-4ef2-4739-ae10-f7802f3d9d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026f15cf-77f9-475c-b9af-5016e3b08a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026f15cf-77f9-475c-b9af-5016e3b08a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-489451125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2a2af3-db03-44a2-8142-0d002fde6856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e4d53b31b645b9bb192997917de9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:37Z,use_quota=True,user_id='f6dcdac5f3634d76a90fa92f01029987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ac0c1c9-adea-4cbe-82f4-d28965447ee7),volume_type_id=3ac0c1c9-adea-4cbe-82f4-d28965447ee7)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5d4bd6-aff7-47ff-ab21-95205c8229d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5d4bd6-aff7-47ff-ab21-95205c8229d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fe85e4-7fb8-45b5-a8af-8173bf7e137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fe85e4-7fb8-45b5-a8af-8173bf7e137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2a2af3-db03-44a2-8142-0d002fde6856', 'volume_name': 'volume-1d2a2af3-db03-44a2-8142-0d002fde6856', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca36a939-b9f2-4e07-bf8f-4e7ae61c8016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca36a939-b9f2-4e07-bf8f-4e7ae61c8016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cddc9c20-c7d9-4fe2-a6af-891225e64e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:36 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Volume 1d2a2af3-db03-44a2-8142-0d002fde6856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2a2af3-db03-44a2-8142-0d002fde6856', 'volume_size': 1}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-489451125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2a2af3-db03-44a2-8142-0d002fde6856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e4d53b31b645b9bb192997917de9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:37Z,use_quota=True,user_id='f6dcdac5f3634d76a90fa92f01029987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ac0c1c9-adea-4cbe-82f4-d28965447ee7),volume_type_id=3ac0c1c9-adea-4cbe-82f4-d28965447ee7)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Creating volume 1d2a2af3-db03-44a2-8142-0d002fde6856 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:03:36 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:03:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:37 devstack sudo[85757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856 1073741824
Feb 27 02:03:37 devstack sudo[85757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:38 devstack sudo[85757]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856 1073741824" returned: 0 in 1.888s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:38 devstack sudo[85884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856
Feb 27 02:03:38 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Flow 'volume_create_manager' (aea66d6e-1408-43fc-8912-360dc8c7a70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51e9e9c-a820-428d-8ae1-8f56fc91a52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51e9e9c-a820-428d-8ae1-8f56fc91a52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-960835982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56f781e-61c8-40fe-9f0f-1c159ea97dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074ec016be8f4252a0c4ecbc46c67762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:39Z,use_quota=True,user_id='7e1373e206ea49fb8db06b41481173e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce16ebc4-4051-46f1-8f74-3a2b413f0683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce16ebc4-4051-46f1-8f74-3a2b413f0683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8136ed2c-3e4f-4a67-8e34-206f5e50e571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8136ed2c-3e4f-4a67-8e34-206f5e50e571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56f781e-61c8-40fe-9f0f-1c159ea97dcc', 'volume_name': 'volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c591bc87-138f-4350-9785-76ede0a2aed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c591bc87-138f-4350-9785-76ede0a2aed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bc4d82-8369-4a06-989c-ad7264106082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:39 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Volume e56f781e-61c8-40fe-9f0f-1c159ea97dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc', 'volume_size': 1}
Feb 27 02:03:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:40 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856" returned: 0 in 1.235s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] <== create_volume: return (3205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.207s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-960835982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56f781e-61c8-40fe-9f0f-1c159ea97dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074ec016be8f4252a0c4ecbc46c67762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:39Z,use_quota=True,user_id='7e1373e206ea49fb8db06b41481173e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Creating volume e56f781e-61c8-40fe-9f0f-1c159ea97dcc {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:03:40 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cddc9c20-c7d9-4fe2-a6af-891225e64e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2a2af3-db03-44a2-8142-0d002fde6856', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5965d8-9258-4fa4-a943-f26ba3f1f65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:40 devstack sudo[85901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc 1073741824
Feb 27 02:03:40 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:40 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Volume volume-1d2a2af3-db03-44a2-8142-0d002fde6856 (1d2a2af3-db03-44a2-8142-0d002fde6856): created successfully
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5965d8-9258-4fa4-a943-f26ba3f1f65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:40 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Flow 'volume_create_manager' (1c9895d4-4ef2-4739-ae10-f7802f3d9d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:40 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-44e94b87-ed38-4745-a2cd-b9bbd0a34da7 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Created volume successfully.
Feb 27 02:03:41 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc 1073741824" returned: 0 in 1.176s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:41 devstack sudo[85914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc
Feb 27 02:03:41 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b3b29f52-efdc-45cb-8d6c-bcf0c68a12c2 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b3b29f52-efdc-45cb-8d6c-bcf0c68a12c2 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b3b29f52-efdc-45cb-8d6c-bcf0c68a12c2 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b3b29f52-efdc-45cb-8d6c-bcf0c68a12c2 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b3b29f52-efdc-45cb-8d6c-bcf0c68a12c2 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b3b29f52-efdc-45cb-8d6c-bcf0c68a12c2 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:41 devstack sudo[85942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:41 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:42 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b3b29f52-efdc-45cb-8d6c-bcf0c68a12c2 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.136s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:42 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-b3b29f52-efdc-45cb-8d6c-bcf0c68a12c2 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:42 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b3b29f52-efdc-45cb-8d6c-bcf0c68a12c2 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Retype volume completed successfully.
Feb 27 02:03:42 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc" returned: 0 in 1.555s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] <== create_volume: return (2802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:03:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.805s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:42 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bc4d82-8369-4a06-989c-ad7264106082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:42 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfc4dd1-26f8-4871-b98f-9bf01ffadefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:43 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Volume volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc (e56f781e-61c8-40fe-9f0f-1c159ea97dcc): created successfully
Feb 27 02:03:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfc4dd1-26f8-4871-b98f-9bf01ffadefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Flow 'volume_create_manager' (aea66d6e-1408-43fc-8912-360dc8c7a70f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:43 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e7dba2cd-3d26-43a6-9f70-450069752633 tempest-VolumesTransfersV355Test-764826151 None] Created volume successfully.
Feb 27 02:03:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Acquiring lock "cinder-1d2a2af3-db03-44a2-8142-0d002fde6856-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "cinder-1d2a2af3-db03-44a2-8142-0d002fde6856-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Acquiring lock "cinder-quobyte-1d2a2af3-db03-44a2-8142-0d002fde6856" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "cinder-quobyte-1d2a2af3-db03-44a2-8142-0d002fde6856" acquired by "delete_volume" :: waited 0.036s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:43 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308ddbe-4aae-4b54-8403-529bad7d4365]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:43 devstack sudo[85980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856
Feb 27 02:03:43 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:44 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856" returned: 0 in 1.061s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:44 devstack sudo[85986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856
Feb 27 02:03:44 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:44 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-151af94c-71d4-4c9c-9260-5a8074f69b8a tempest-VolumesTransfersV355Test-1732261496 None] Transfer volume completed successfully.
Feb 27 02:03:45 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1d2a2af3-db03-44a2-8142-0d002fde6856" returned: 0 in 0.591s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "cinder-quobyte-1d2a2af3-db03-44a2-8142-0d002fde6856" released by "delete_volume" :: held 1.784s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:45 devstack cinder-volume[83140]: WARNING cinder.quota [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:03:45 devstack cinder-volume[83140]: WARNING cinder.quota [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Created reservations ['84033526-74bd-403e-b02e-fca96f88e847', 'f9f52fe5-5d8a-4d4b-a36d-ca63f70f5caf', '4030553b-15d9-42c3-affc-b30cdc2822b3', 'a8156068-95e3-4cdc-908a-5a8bddd0b102'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:45 devstack sudo[85989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:45 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:45 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-16398383-d3ca-4674-828d-df66fee2d657 req-7fa0d044-387a-4942-b296-4e649ff16798 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Terminate volume connection completed successfully.
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-16398383-d3ca-4674-828d-df66fee2d657 req-7fa0d044-387a-4942-b296-4e649ff16798 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Deleting attachment 7e091323-f2d4-4ea8-be19-69fdfaece54a. {{(pid=83140) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Flow 'volume_create_manager' (adcadb88-cffc-4ccd-8a9a-c673ca46f33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc38497e-84a6-4d94-abe8-ac9bedc65f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc38497e-84a6-4d94-abe8-ac9bedc65f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-302992301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f9140f-06cc-42ac-8a26-c7ca451fea01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f3cf1af5614357ac785599f09d5343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:45Z,use_quota=True,user_id='67e44366206646dd955a731c98f85559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cd3dd6-11ad-489c-836d-e65c46ac09ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cd3dd6-11ad-489c-836d-e65c46ac09ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce0bb0f-a31f-4bfe-9ead-83888157f325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce0bb0f-a31f-4bfe-9ead-83888157f325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f9140f-06cc-42ac-8a26-c7ca451fea01', 'volume_name': 'volume-66f9140f-06cc-42ac-8a26-c7ca451fea01', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2657df-0211-4bdb-816e-c182a6c4457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2657df-0211-4bdb-816e-c182a6c4457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1f4060-fdd6-4495-919a-16d98484db3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:45 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Volume 66f9140f-06cc-42ac-8a26-c7ca451fea01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f9140f-06cc-42ac-8a26-c7ca451fea01', 'volume_size': 1}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-302992301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f9140f-06cc-42ac-8a26-c7ca451fea01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39f3cf1af5614357ac785599f09d5343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:45Z,use_quota=True,user_id='67e44366206646dd955a731c98f85559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Creating volume 66f9140f-06cc-42ac-8a26-c7ca451fea01 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:03:45 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:45 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01 1073741824
Feb 27 02:03:45 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Acquiring lock "cinder-e56f781e-61c8-40fe-9f0f-1c159ea97dcc-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Lock "cinder-e56f781e-61c8-40fe-9f0f-1c159ea97dcc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Acquiring lock "cinder-quobyte-e56f781e-61c8-40fe-9f0f-1c159ea97dcc" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Lock "cinder-quobyte-e56f781e-61c8-40fe-9f0f-1c159ea97dcc" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[de223571-cd1f-4582-98d8-efa7f959f8f6]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "cinder-cb87f157-c32c-4174-96ee-7c935cfd3783-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "cinder-cb87f157-c32c-4174-96ee-7c935cfd3783-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:46 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.060s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:46 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Deleted volume successfully.
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "cinder-quobyte-cb87f157-c32c-4174-96ee-7c935cfd3783" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3017b6e0-4446-4e74-8a3b-1fbb5d0bfa47 tempest-VolumeRetypeWithoutMigrationTest-619187134 None] Lock "cinder-1d2a2af3-db03-44a2-8142-0d002fde6856-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:46 devstack sudo[85994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "cinder-quobyte-cb87f157-c32c-4174-96ee-7c935cfd3783" acquired by "delete_volume" :: waited 0.021s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:46 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f42e152-3d1f-420e-a3b7-212c5d65a4c7]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:46 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783
Feb 27 02:03:46 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:47 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc" returned: 0 in 1.280s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:47 devstack sudo[86004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc
Feb 27 02:03:47 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:47 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01 1073741824" returned: 0 in 1.986s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:47 devstack sudo[86010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01
Feb 27 02:03:47 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:47 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783" returned: 0 in 1.298s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:48 devstack sudo[86013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783
Feb 27 02:03:48 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:48 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e56f781e-61c8-40fe-9f0f-1c159ea97dcc" returned: 0 in 1.224s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Lock "cinder-quobyte-e56f781e-61c8-40fe-9f0f-1c159ea97dcc" released by "delete_volume" :: held 2.626s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:48 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01" returned: 0 in 0.962s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] <== create_volume: return (2999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Created reservations ['ee7abb08-3588-4be8-b5c4-4ca1356b3222', '8a1ce23d-9420-4b07-a9ae-d740a8f3c4af', '22dffaa3-45fe-4be5-b7e6-4384b58a770a', 'cf7a7ca7-9e53-42db-92d1-ce5e8b9fa0a2'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:48 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783" returned: 1 in 0.923s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:48 devstack sudo[86020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783
Feb 27 02:03:48 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1f4060-fdd6-4495-919a-16d98484db3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f9140f-06cc-42ac-8a26-c7ca451fea01', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bc2187-25e4-479b-a4e9-4b21ee812ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:48 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Volume volume-66f9140f-06cc-42ac-8a26-c7ca451fea01 (66f9140f-06cc-42ac-8a26-c7ca451fea01): created successfully
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bc2187-25e4-479b-a4e9-4b21ee812ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:48 devstack sudo[86022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:48 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Flow 'volume_create_manager' (adcadb88-cffc-4ccd-8a9a-c673ca46f33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:49 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1cb4f4d0-174f-4418-8cad-5df58ee475b1 tempest-ServerRescueNegativeTestJSON-1888493024 None] Created volume successfully.
Feb 27 02:03:49 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb87f157-c32c-4174-96ee-7c935cfd3783" returned: 0 in 1.192s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "cinder-quobyte-cb87f157-c32c-4174-96ee-7c935cfd3783" released by "delete_volume" :: held 3.633s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:50 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.quota [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Created reservations ['a1ab3650-b269-4873-b7c0-b17a0be3495e', '192ad3a2-66ea-4516-9e18-0a82d60ec698', 'e42c938b-d3ff-4436-811e-fd5220621497', 'd0ff9600-4fed-43e0-ba1b-09b960235751'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.313s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:50 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Deleted volume successfully.
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Flow 'volume_create_manager' (eac72d08-d42f-418c-8d79-a58fdaa54dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad94ba8-1d5d-4f2c-beb5-c71dd967bfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad94ba8-1d5d-4f2c-beb5-c71dd967bfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1414372509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d2c564-4d86-462a-aa18-7dab7fee9b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074ec016be8f4252a0c4ecbc46c67762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:50Z,use_quota=True,user_id='7e1373e206ea49fb8db06b41481173e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3042ffe-c577-4dc6-9a6f-2ef45df62c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3042ffe-c577-4dc6-9a6f-2ef45df62c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27ca73d-6fb6-4282-b01f-dbf6b2dbad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27ca73d-6fb6-4282-b01f-dbf6b2dbad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d2c564-4d86-462a-aa18-7dab7fee9b0d', 'volume_name': 'volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a0fed2-6a4b-49d0-b46d-674c43a83518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a0fed2-6a4b-49d0-b46d-674c43a83518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba23953-4e4a-46a6-97bd-dc9504707612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:50 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Volume e5d2c564-4d86-462a-aa18-7dab7fee9b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d', 'volume_size': 1}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1414372509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d2c564-4d86-462a-aa18-7dab7fee9b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='074ec016be8f4252a0c4ecbc46c67762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:50Z,use_quota=True,user_id='7e1373e206ea49fb8db06b41481173e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Creating volume e5d2c564-4d86-462a-aa18-7dab7fee9b0d {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:03:50 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2b627e84-511b-41fa-aad7-062090db9eae tempest-VolumesTransfersV355Test-229659789 None] Lock "cinder-e56f781e-61c8-40fe-9f0f-1c159ea97dcc-delete_volume" released by "delete_volume" :: held 4.649s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:50 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d 1073741824
Feb 27 02:03:50 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:50 devstack sudo[86029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:50 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:51 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.141s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:51 devstack cinder-volume[83140]: DEBUG cinder.manager [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Deleted volume successfully.
Feb 27 02:03:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-16398383-d3ca-4674-828d-df66fee2d657 req-fb457687-887d-4c28-a412-ae579fce9e89 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "cinder-cb87f157-c32c-4174-96ee-7c935cfd3783-delete_volume" released by "delete_volume" :: held 5.528s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:51 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d 1073741824" returned: 0 in 1.533s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:52 devstack sudo[86062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d
Feb 27 02:03:52 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:52 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d" returned: 0 in 0.937s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:03:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.536s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba23953-4e4a-46a6-97bd-dc9504707612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17640c99-46a8-45a2-915e-5dc80f22c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:53 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Volume volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d (e5d2c564-4d86-462a-aa18-7dab7fee9b0d): created successfully
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17640c99-46a8-45a2-915e-5dc80f22c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Flow 'volume_create_manager' (eac72d08-d42f-418c-8d79-a58fdaa54dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:53 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8b55f015-da8f-4258-89c6-1d4bc24bd29f tempest-VolumesTransfersV355Test-764826151 None] Created volume successfully.
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Flow 'volume_create_manager' (ea7f73e0-3f84-490c-be8a-25f8c5a63ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136fd41d-b1d1-4187-b8fe-e7117ef525e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136fd41d-b1d1-4187-b8fe-e7117ef525e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1215678409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238d968e-1ff5-4aba-9f0a-aadade58d756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6282411ea640528cad80bd88addbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:53Z,use_quota=True,user_id='1bd97b7b24dc4675866e75ade7940dd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb7b2dc-d8d7-4648-90de-9d38348e34b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb7b2dc-d8d7-4648-90de-9d38348e34b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7975b19f-e616-4bc1-a1f4-5b7cb9befce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7975b19f-e616-4bc1-a1f4-5b7cb9befce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238d968e-1ff5-4aba-9f0a-aadade58d756', 'volume_name': 'volume-238d968e-1ff5-4aba-9f0a-aadade58d756', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d145d735-fe0b-422b-a5c5-42198ca8b699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d145d735-fe0b-422b-a5c5-42198ca8b699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5ba071-3c7b-43b1-bbef-89075ac35db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:53 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Volume 238d968e-1ff5-4aba-9f0a-aadade58d756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238d968e-1ff5-4aba-9f0a-aadade58d756', 'volume_size': 1}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1215678409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238d968e-1ff5-4aba-9f0a-aadade58d756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6282411ea640528cad80bd88addbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:53Z,use_quota=True,user_id='1bd97b7b24dc4675866e75ade7940dd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Creating volume 238d968e-1ff5-4aba-9f0a-aadade58d756 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:03:53 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:53 devstack sudo[86079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756 1073741824
Feb 27 02:03:53 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Acquiring lock "cinder-e5d2c564-4d86-462a-aa18-7dab7fee9b0d-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Lock "cinder-e5d2c564-4d86-462a-aa18-7dab7fee9b0d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Acquiring lock "cinder-quobyte-e5d2c564-4d86-462a-aa18-7dab7fee9b0d" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Lock "cinder-quobyte-e5d2c564-4d86-462a-aa18-7dab7fee9b0d" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba691b2-3348-4e2f-8a33-80e5504e76cf]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:53 devstack sudo[86081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d
Feb 27 02:03:53 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:54 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756 1073741824" returned: 0 in 1.024s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:54 devstack sudo[86109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756
Feb 27 02:03:54 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:54 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d" returned: 0 in 0.894s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:54 devstack sudo[86111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d
Feb 27 02:03:54 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:55 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e5d2c564-4d86-462a-aa18-7dab7fee9b0d" returned: 0 in 0.458s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Lock "cinder-quobyte-e5d2c564-4d86-462a-aa18-7dab7fee9b0d" released by "delete_volume" :: held 1.394s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Created reservations ['4fdd991d-3cc1-430b-8bfa-edce80b8a085', '017db0a4-650e-4530-b1b3-940c016b83eb', 'f3f18ec0-bba9-4a5b-bbde-a976f9f49ab7', 'a25ac153-8b8b-4144-bd58-5d3654c785a1'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:03:55 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756" returned: 0 in 0.615s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5ba071-3c7b-43b1-bbef-89075ac35db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238d968e-1ff5-4aba-9f0a-aadade58d756', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a81c05-f654-4c06-984c-9acbea3247e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:03:55 devstack sudo[86116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:03:55 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:55 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Volume volume-238d968e-1ff5-4aba-9f0a-aadade58d756 (238d968e-1ff5-4aba-9f0a-aadade58d756): created successfully
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a81c05-f654-4c06-984c-9acbea3247e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Flow 'volume_create_manager' (ea7f73e0-3f84-490c-be8a-25f8c5a63ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:03:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-da54bb17-89b7-488c-aa0f-15369f0a98b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Created volume successfully.
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Creating offline snapshot 2468567c-c277-491f-806d-a608b16256d8 of volume 238d968e-1ff5-4aba-9f0a-aadade58d756 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b990d6a5-4686-4850-a0e0-8c942a0dc74f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:03:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:55 devstack sudo[86125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756
Feb 27 02:03:55 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:56 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.711s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:56 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:03:56 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Deleted volume successfully.
Feb 27 02:03:56 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7683bf9f-cec1-45fe-9ee2-e3dc9ced6a56 tempest-VolumesTransfersV355Test-229659789 None] Lock "cinder-e5d2c564-4d86-462a-aa18-7dab7fee9b0d-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:03:56 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756" returned: 0 in 0.646s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:56 devstack sudo[86130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 1G
Feb 27 02:03:56 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:57 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 1G" returned: 0 in 0.816s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238d968e-1ff5-4aba-9f0a-aadade58d756 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:57 devstack sudo[86145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238d968e-1ff5-4aba-9f0a-aadade58d756 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8
Feb 27 02:03:57 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:57 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238d968e-1ff5-4aba-9f0a-aadade58d756 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8" returned: 0 in 0.612s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:57 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 is being set with open permissions: ugo+rw
Feb 27 02:03:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:57 devstack sudo[86172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8
Feb 27 02:03:57 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:58 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8" returned: 0 in 0.716s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:58 devstack sudo[86180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.info
Feb 27 02:03:58 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:03:59 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root
Feb 27 02:03:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.info" returned: 0 in 0.724s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:03:59 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.info is being set with open permissions: ugo+rw
Feb 27 02:03:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:03:59 devstack sudo[86210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.info
Feb 27 02:03:59 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:00 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.info" returned: 0 in 0.706s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.326s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:00 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-65c3039e-2825-4de4-bd4e-2d801b16511c tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Terminate volume connection completed successfully.
Feb 27 02:04:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-65c3039e-2825-4de4-bd4e-2d801b16511c tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Deleting attachment 31309f17-f8ca-4123-aba1-8d4e1ff00676. {{(pid=83140) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Feb 27 02:04:00 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bf8a8d26-3e80-4a2a-be1e-a453079e1da7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Create snapshot completed successfully
Feb 27 02:04:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "cinder-75b567e5-f985-4802-9ba4-34c8c1201b57-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "cinder-75b567e5-f985-4802-9ba4-34c8c1201b57-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "cinder-quobyte-75b567e5-f985-4802-9ba4-34c8c1201b57" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "cinder-quobyte-75b567e5-f985-4802-9ba4-34c8c1201b57" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:00 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b687cd3d-0e8e-494c-88fb-4827f7aa7e0b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:01 devstack sudo[86215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57
Feb 27 02:04:01 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Acquiring lock "cinder-2468567c-c277-491f-806d-a608b16256d8-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-2468567c-c277-491f-806d-a608b16256d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Acquiring lock "cinder-quobyte-238d968e-1ff5-4aba-9f0a-aadade58d756" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-quobyte-238d968e-1ff5-4aba-9f0a-aadade58d756" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Acquiring lock "cinder-quobyte-2468567c-c277-491f-806d-a608b16256d8" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-quobyte-2468567c-c277-491f-806d-a608b16256d8" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Deleting offline snapshot 2468567c-c277-491f-806d-a608b16256d8 of volume 238d968e-1ff5-4aba-9f0a-aadade58d756 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:04:02 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] snapshot_file for this snap is: volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:04:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57" returned: 0 in 1.221s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:02 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[24902433-0061-4baf-8245-c4831e3bb69e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:02 devstack sudo[86220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57
Feb 27 02:04:02 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:02 devstack sudo[86221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8
Feb 27 02:04:02 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:03 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75b567e5-f985-4802-9ba4-34c8c1201b57" returned: 0 in 1.308s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "cinder-quobyte-75b567e5-f985-4802-9ba4-34c8c1201b57" released by "delete_volume" :: held 2.594s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:03 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8" returned: 0 in 1.388s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-238d968e-1ff5-4aba-9f0a-aadade58d756(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[83564343-80a6-4d50-8008-a5ebc99713ee]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Flow 'volume_create_manager' (279eb20c-2a90-48da-9acc-968d316cf4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452feb26-c3a3-4099-b312-67ab28ec36cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452feb26-c3a3-4099-b312-67ab28ec36cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1983445821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35cde77-3a2d-4112-b67e-e56de16c1695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ef5f663e64bf4a41d86e9cfae7688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:03Z,use_quota=True,user_id='d813e5e4b29449a587c31f549759e527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13d106a-bf84-46ef-b958-b5d5a908cbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13d106a-bf84-46ef-b958-b5d5a908cbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5f3705-e08b-4eed-adff-82e0db8a11cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5f3705-e08b-4eed-adff-82e0db8a11cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b35cde77-3a2d-4112-b67e-e56de16c1695', 'volume_name': 'volume-b35cde77-3a2d-4112-b67e-e56de16c1695', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49760dde-c88d-4ca3-8062-91f27c59683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:03 devstack sudo[86229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756
Feb 27 02:04:03 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49760dde-c88d-4ca3-8062-91f27c59683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797c7bd1-4cf4-41d4-9922-1119e77d498e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:03 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Volume b35cde77-3a2d-4112-b67e-e56de16c1695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b35cde77-3a2d-4112-b67e-e56de16c1695', 'volume_size': 1}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1983445821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35cde77-3a2d-4112-b67e-e56de16c1695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ef5f663e64bf4a41d86e9cfae7688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:03Z,use_quota=True,user_id='d813e5e4b29449a587c31f549759e527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Creating volume b35cde77-3a2d-4112-b67e-e56de16c1695 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:04:03 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.quota [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Created reservations ['2cba82e6-7dc9-4dfd-8995-30d1fe88c149', '3b32f512-4bf8-4dac-ad84-47c922c760e9', '23fddfb3-3093-4511-b1e4-29f9df08b1f7', '267dabc8-ee30-4158-b277-9704c1de51a7'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:03 devstack sudo[86231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695 1073741824
Feb 27 02:04:03 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:03 devstack sudo[86233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:03 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:04 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756" returned: 0 in 0.841s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:04 devstack sudo[86238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8
Feb 27 02:04:04 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:04 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.136s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:04 devstack cinder-volume[83140]: DEBUG cinder.manager [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:04 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Deleted volume successfully.
Feb 27 02:04:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-5fa27c3e-f0b9-4541-8aca-2c97116f8037 req-7ef9f274-d29e-4bf4-8cda-4d48069a3d57 tempest-ServerBootFromVolumeStableRescueTest-2085564201 None] Lock "cinder-75b567e5-f985-4802-9ba4-34c8c1201b57-delete_volume" released by "delete_volume" :: held 4.182s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:05 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695 1073741824" returned: 0 in 1.379s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:05 devstack sudo[86267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695
Feb 27 02:04:05 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:05 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8" returned: 0 in 0.902s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:05 devstack sudo[86271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8
Feb 27 02:04:05 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:05 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695" returned: 0 in 0.799s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:04:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797c7bd1-4cf4-41d4-9922-1119e77d498e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35cde77-3a2d-4112-b67e-e56de16c1695', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71af5612-49fb-46b6-93c2-c5d9bef64933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:06 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Volume volume-b35cde77-3a2d-4112-b67e-e56de16c1695 (b35cde77-3a2d-4112-b67e-e56de16c1695): created successfully
Feb 27 02:04:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71af5612-49fb-46b6-93c2-c5d9bef64933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Flow 'volume_create_manager' (279eb20c-2a90-48da-9acc-968d316cf4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:06 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1a7ef655-ba36-48fd-8e88-c7bb41c00260 tempest-VolumesTransfersV357Test-707384180 None] Created volume successfully.
Feb 27 02:04:06 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756.2468567c-c277-491f-806d-a608b16256d8" returned: 0 in 0.818s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-quobyte-2468567c-c277-491f-806d-a608b16256d8" released by "_delete_snapshot" :: held 4.175s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-quobyte-238d968e-1ff5-4aba-9f0a-aadade58d756" released by "delete_snapshot" :: held 4.214s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:06 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Created reservations ['4cbc1d76-d29b-44b8-95f2-671c3a248300', 'f173d429-4513-4b1c-8e14-ed570f661745', '97ce8aff-be91-48ca-9e1b-d94b1c9897b1', '80dc0555-0eaf-4196-87a6-cb0ea3e332a4'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:06 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Delete snapshot completed successfully.
Feb 27 02:04:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-94f78b9b-0341-42c0-a6e5-d2bc51d94041 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-2468567c-c277-491f-806d-a608b16256d8-delete_snapshot" released by "delete_snapshot" :: held 4.407s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-36c4c4a4-acb4-44ef-bfe6-17b28551f734 tempest-VolumesTransfersV357Test-1538385275 None] Transfer volume completed successfully.
Feb 27 02:04:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Acquiring lock "cinder-238d968e-1ff5-4aba-9f0a-aadade58d756-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-238d968e-1ff5-4aba-9f0a-aadade58d756-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Acquiring lock "cinder-quobyte-238d968e-1ff5-4aba-9f0a-aadade58d756" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-quobyte-238d968e-1ff5-4aba-9f0a-aadade58d756" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:07 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3433f3-e832-4b54-ab89-653e73438109]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:07 devstack sudo[86327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756
Feb 27 02:04:07 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Acquiring lock "cinder-66f9140f-06cc-42ac-8a26-c7ca451fea01-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "cinder-66f9140f-06cc-42ac-8a26-c7ca451fea01-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Acquiring lock "cinder-quobyte-66f9140f-06cc-42ac-8a26-c7ca451fea01" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "cinder-quobyte-66f9140f-06cc-42ac-8a26-c7ca451fea01" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4e3403-7660-4188-b43e-77ea00c7e1bc]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Acquiring lock "cinder-b35cde77-3a2d-4112-b67e-e56de16c1695-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Lock "cinder-b35cde77-3a2d-4112-b67e-e56de16c1695-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:08 devstack sudo[86330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01
Feb 27 02:04:08 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Acquiring lock "cinder-quobyte-b35cde77-3a2d-4112-b67e-e56de16c1695" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Lock "cinder-quobyte-b35cde77-3a2d-4112-b67e-e56de16c1695" acquired by "delete_volume" :: waited 0.035s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:08 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756" returned: 0 in 0.990s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a58620-713c-4fa7-b047-09ae22f0b977]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:08 devstack sudo[86335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756
Feb 27 02:04:08 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:08 devstack sudo[86336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695
Feb 27 02:04:08 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:09 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695" returned: 0 in 0.558s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:09 devstack sudo[86342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695
Feb 27 02:04:09 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:09 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01" returned: 0 in 1.017s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:09 devstack sudo[86349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01
Feb 27 02:04:09 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:09 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-238d968e-1ff5-4aba-9f0a-aadade58d756" returned: 0 in 0.922s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-quobyte-238d968e-1ff5-4aba-9f0a-aadade58d756" released by "delete_volume" :: held 1.984s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Created reservations ['5d817016-4584-4be0-a34d-77235695a03b', '96ab9b40-d899-4422-b6ba-46fcd865fd88', 'dc85f9d2-0b23-400b-be74-b17b1b1df233', 'e61cfda9-a1b0-4abe-988e-93f45791debb'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:09 devstack sudo[86351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:09 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:09 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-66f9140f-06cc-42ac-8a26-c7ca451fea01" returned: 0 in 0.692s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "cinder-quobyte-66f9140f-06cc-42ac-8a26-c7ca451fea01" released by "delete_volume" :: held 1.784s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Created reservations ['9e1dfe95-57bf-4f79-aa8d-2d9cc70954cd', '524ae78c-3a63-4883-894f-79664208c33e', '29d98f28-3f9b-4f5c-a13f-cf8162396b61', '31dc7e0a-0b1f-4b68-8311-da4ce599747d'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:10 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b35cde77-3a2d-4112-b67e-e56de16c1695" returned: 0 in 1.038s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Lock "cinder-quobyte-b35cde77-3a2d-4112-b67e-e56de16c1695" released by "delete_volume" :: held 1.681s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:10 devstack sudo[86355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:10 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Created reservations ['aa814a22-8766-4ccc-b116-9f03b76b1534', '83b5a901-37a2-4f29-bf3e-2746fab5d694', '960bf234-21f3-4699-b0a3-5e28a6d241e8', 'bf0a0e12-f947-475b-9330-34985a075340'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:10 devstack sudo[86360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:10 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:10 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.716s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:10 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Deleted volume successfully.
Feb 27 02:04:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e9c76357-a1b9-45ef-92f3-46782192e3d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1718361038 None] Lock "cinder-238d968e-1ff5-4aba-9f0a-aadade58d756-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:11 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.058s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:11 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Deleted volume successfully.
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c8a80d13-9338-4ace-99b1-1d781ad7b23e tempest-ServerRescueNegativeTestJSON-1888493024 None] Lock "cinder-66f9140f-06cc-42ac-8a26-c7ca451fea01-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:11 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.144s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:11 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Deleted volume successfully.
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe2b99e3-06a3-4f29-b6e4-09be8caf3761 tempest-VolumesTransfersV357Test-2117544653 None] Lock "cinder-b35cde77-3a2d-4112-b67e-e56de16c1695-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Flow 'volume_create_manager' (67f2971e-3dd5-4490-8634-9f49c1a5c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e85d36-34de-4d89-95b5-20eb563fd2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e85d36-34de-4d89-95b5-20eb563fd2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-823124870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b94cf55-242f-4d73-adc8-006fcc74ce1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ef5f663e64bf4a41d86e9cfae7688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:12Z,use_quota=True,user_id='d813e5e4b29449a587c31f549759e527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea4005b-1faf-4cdd-a8cd-4b5db3172373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea4005b-1faf-4cdd-a8cd-4b5db3172373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d182ea6a-08a5-402d-a25b-5d1d9a945d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d182ea6a-08a5-402d-a25b-5d1d9a945d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b94cf55-242f-4d73-adc8-006fcc74ce1d', 'volume_name': 'volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912a2a88-8c60-4030-b849-548a4743779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912a2a88-8c60-4030-b849-548a4743779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a286eff5-2028-4815-9a7b-d2243251ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:11 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Volume 6b94cf55-242f-4d73-adc8-006fcc74ce1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d', 'volume_size': 1}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-823124870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b94cf55-242f-4d73-adc8-006fcc74ce1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ef5f663e64bf4a41d86e9cfae7688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:12Z,use_quota=True,user_id='d813e5e4b29449a587c31f549759e527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Creating volume 6b94cf55-242f-4d73-adc8-006fcc74ce1d {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:04:11 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:04:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:11 devstack sudo[86370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d 1073741824
Feb 27 02:04:11 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:12 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d 1073741824" returned: 0 in 1.184s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:12 devstack sudo[86401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d
Feb 27 02:04:12 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:13 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d" returned: 0 in 0.534s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:04:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:13 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a286eff5-2028-4815-9a7b-d2243251ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:13 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4659350-b0ab-4e66-8405-49f891058659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:13 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Volume volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d (6b94cf55-242f-4d73-adc8-006fcc74ce1d): created successfully
Feb 27 02:04:13 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4659350-b0ab-4e66-8405-49f891058659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:13 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Flow 'volume_create_manager' (67f2971e-3dd5-4490-8634-9f49c1a5c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:13 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d3052bc5-1103-45b9-b99e-b3e8594f54d2 tempest-VolumesTransfersV357Test-707384180 None] Created volume successfully.
Feb 27 02:04:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Acquiring lock "cinder-6b94cf55-242f-4d73-adc8-006fcc74ce1d-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Lock "cinder-6b94cf55-242f-4d73-adc8-006fcc74ce1d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Acquiring lock "cinder-quobyte-6b94cf55-242f-4d73-adc8-006fcc74ce1d" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Lock "cinder-quobyte-6b94cf55-242f-4d73-adc8-006fcc74ce1d" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:14 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7389b958-6fd5-4d5c-a56f-60c4923aa39c]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:14 devstack sudo[86406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d
Feb 27 02:04:14 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:14 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d" returned: 0 in 0.670s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:14 devstack sudo[86411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d
Feb 27 02:04:14 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:15 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6b94cf55-242f-4d73-adc8-006fcc74ce1d" returned: 0 in 0.556s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Lock "cinder-quobyte-6b94cf55-242f-4d73-adc8-006fcc74ce1d" released by "delete_volume" :: held 1.276s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:15 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Created reservations ['6cde667f-bed0-4a45-acac-023b39ed6cb7', '26ade64d-659d-4346-9122-d17c6729a55e', '71525b46-409e-4f08-be50-2a7f63cdb3a6', 'fb0173f5-2f7d-4db1-bef0-578c88d0314a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:15 devstack sudo[86414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:15 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:16 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.555s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:16 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:16 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Deleted volume successfully.
Feb 27 02:04:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-601d6779-474b-47ba-831a-90fb6fd69c98 tempest-VolumesTransfersV357Test-2117544653 None] Lock "cinder-6b94cf55-242f-4d73-adc8-006fcc74ce1d-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:16 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Flow 'volume_create_manager' (c3201ca3-ab42-4de9-b8e9-77113792129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dda8db0-60f3-4380-9e59-8b30919ae976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dda8db0-60f3-4380-9e59-8b30919ae976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1170897374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85088490-e05a-4821-afe3-dbae4615c8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786aaf6a7aaa44c0a1121b8845aa2156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:17Z,use_quota=True,user_id='49e73c2831904626ac14562fafadcd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2460b7e-558e-4a99-a149-bee8b869acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2460b7e-558e-4a99-a149-bee8b869acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8a6d02-4e6b-4203-b297-b59ec89cc9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8a6d02-4e6b-4203-b297-b59ec89cc9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85088490-e05a-4821-afe3-dbae4615c8cd', 'volume_name': 'volume-85088490-e05a-4821-afe3-dbae4615c8cd', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690ce267-68b2-4a3a-a1fd-8932104825b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690ce267-68b2-4a3a-a1fd-8932104825b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15326874-bd01-4943-aef9-1fdb783e527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:17 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Volume 85088490-e05a-4821-afe3-dbae4615c8cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85088490-e05a-4821-afe3-dbae4615c8cd', 'volume_size': 1}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1170897374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85088490-e05a-4821-afe3-dbae4615c8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786aaf6a7aaa44c0a1121b8845aa2156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:17Z,use_quota=True,user_id='49e73c2831904626ac14562fafadcd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Creating volume 85088490-e05a-4821-afe3-dbae4615c8cd {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:04:17 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:17 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd 1073741824
Feb 27 02:04:17 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:17 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd 1073741824" returned: 0 in 0.711s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:17 devstack sudo[86423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd
Feb 27 02:04:17 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:18 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd" returned: 0 in 0.643s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:18 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:04:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15326874-bd01-4943-aef9-1fdb783e527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85088490-e05a-4821-afe3-dbae4615c8cd', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68cd3430-a406-4277-980e-d6fac0889433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:18 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Volume volume-85088490-e05a-4821-afe3-dbae4615c8cd (85088490-e05a-4821-afe3-dbae4615c8cd): created successfully
Feb 27 02:04:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68cd3430-a406-4277-980e-d6fac0889433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Flow 'volume_create_manager' (c3201ca3-ab42-4de9-b8e9-77113792129f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:18 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-caa8aec1-4f16-46e1-9771-4d93311b73b1 tempest-VolumesListAdminTestJSON-273175317 None] Created volume successfully.
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Flow 'volume_create_manager' (1bffe6ae-9d01-4caa-a6ca-50645d268093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289ddfaf-3508-41b7-b3dd-3b177de003b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289ddfaf-3508-41b7-b3dd-3b177de003b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2107908269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786aaf6a7aaa44c0a1121b8845aa2156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:20Z,use_quota=True,user_id='49e73c2831904626ac14562fafadcd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e1b6ba-be16-4510-b209-3a30dad510a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e1b6ba-be16-4510-b209-3a30dad510a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c1cef3-7d3a-4d40-9e0a-17ed63a595de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c1cef3-7d3a-4d40-9e0a-17ed63a595de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9', 'volume_name': 'volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd525ab-9f3e-4bf1-a4ec-48b5edecd199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd525ab-9f3e-4bf1-a4ec-48b5edecd199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b56d6b2-5491-4d71-b8c5-09b14913e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Volume cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9', 'volume_size': 1}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2107908269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786aaf6a7aaa44c0a1121b8845aa2156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:20Z,use_quota=True,user_id='49e73c2831904626ac14562fafadcd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Creating volume cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:04:19 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:04:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:19 devstack sudo[86452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9 1073741824
Feb 27 02:04:19 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:20 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9 1073741824" returned: 0 in 0.751s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:20 devstack sudo[86459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9
Feb 27 02:04:20 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:21 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9" returned: 0 in 0.651s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:04:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b56d6b2-5491-4d71-b8c5-09b14913e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39eec6f8-de10-41bc-9173-300a24bc8149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:21 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Volume volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9 (cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9): created successfully
Feb 27 02:04:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39eec6f8-de10-41bc-9173-300a24bc8149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Flow 'volume_create_manager' (1bffe6ae-9d01-4caa-a6ca-50645d268093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:21 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=118,cinder:SELECT=89,cinder:INSERT=26,cinder:DELETE=11 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:04:21 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9ae7e636-7906-4d39-9165-6ba356d2e3d1 tempest-VolumesListAdminTestJSON-273175317 None] Created volume successfully.
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Flow 'volume_create_manager' (fab2c9fd-942d-4b90-8217-71c496f32b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63146a9b-0450-4236-b8be-a1744e214220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63146a9b-0450-4236-b8be-a1744e214220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-591914238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2a7564-8e88-4bfb-b96b-15ca61f20cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786aaf6a7aaa44c0a1121b8845aa2156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:22Z,use_quota=True,user_id='49e73c2831904626ac14562fafadcd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7847e8-f2f8-4334-abbe-f3bd08716188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7847e8-f2f8-4334-abbe-f3bd08716188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50572d9f-d892-4403-be0c-1db87d867f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50572d9f-d892-4403-be0c-1db87d867f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a2a7564-8e88-4bfb-b96b-15ca61f20cdb', 'volume_name': 'volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76df68a-5e15-4cca-897a-34353bacca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76df68a-5e15-4cca-897a-34353bacca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8531d05f-c0d0-4ba5-abe8-b78c23277c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:22 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Volume 1a2a7564-8e88-4bfb-b96b-15ca61f20cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb', 'volume_size': 1}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-591914238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2a7564-8e88-4bfb-b96b-15ca61f20cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786aaf6a7aaa44c0a1121b8845aa2156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:22Z,use_quota=True,user_id='49e73c2831904626ac14562fafadcd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Creating volume 1a2a7564-8e88-4bfb-b96b-15ca61f20cdb {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:04:22 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:04:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:22 devstack sudo[86463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb 1073741824
Feb 27 02:04:22 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:23 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb 1073741824" returned: 0 in 0.838s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:23 devstack sudo[86469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb
Feb 27 02:04:23 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:23 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb" returned: 0 in 0.515s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:04:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8531d05f-c0d0-4ba5-abe8-b78c23277c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1872be-78d9-485c-a9f7-3046335f4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:23 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Volume volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb (1a2a7564-8e88-4bfb-b96b-15ca61f20cdb): created successfully
Feb 27 02:04:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1872be-78d9-485c-a9f7-3046335f4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Flow 'volume_create_manager' (fab2c9fd-942d-4b90-8217-71c496f32b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:23 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-48de561a-931e-48de-a618-5d01ae443937 tempest-VolumesListAdminTestJSON-273175317 None] Created volume successfully.
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=91,cinder:UPDATE=129,cinder:INSERT=30,cinder:DELETE=10 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Flow 'volume_create_manager' (781a8708-3f3e-4b0f-bf9b-52fdbf12b893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a289595c-3e7d-406f-919e-28448347cd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a289595c-3e7d-406f-919e-28448347cd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578ba482-23cc-4bd9-8b8b-54389d7de06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493d0b2bf0b248f6975ee16d128b679e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:25Z,use_quota=True,user_id='852f10971e2d43fdb948005ff5a452dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d743722-226a-48fe-b3c2-cf4c5f87c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d743722-226a-48fe-b3c2-cf4c5f87c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa87e6d9-056e-4c1c-bc3f-5fe814e7a90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa87e6d9-056e-4c1c-bc3f-5fe814e7a90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '578ba482-23cc-4bd9-8b8b-54389d7de06f', 'volume_name': 'volume-578ba482-23cc-4bd9-8b8b-54389d7de06f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedea4af-eb13-4ff8-a685-2a889aaeb1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedea4af-eb13-4ff8-a685-2a889aaeb1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7895384-d16c-449e-bbc4-393976699204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:25 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Volume 578ba482-23cc-4bd9-8b8b-54389d7de06f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-578ba482-23cc-4bd9-8b8b-54389d7de06f', 'volume_size': 1}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578ba482-23cc-4bd9-8b8b-54389d7de06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493d0b2bf0b248f6975ee16d128b679e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:25Z,use_quota=True,user_id='852f10971e2d43fdb948005ff5a452dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Creating volume 578ba482-23cc-4bd9-8b8b-54389d7de06f {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:04:25 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:25 devstack sudo[86472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f 1073741824
Feb 27 02:04:25 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:25 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f 1073741824" returned: 0 in 0.629s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:25 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f
Feb 27 02:04:25 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:26 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f" returned: 0 in 0.493s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:04:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7895384-d16c-449e-bbc4-393976699204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-578ba482-23cc-4bd9-8b8b-54389d7de06f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e837f8c-a84b-4626-97ac-65130e7f84a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:26 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Volume volume-578ba482-23cc-4bd9-8b8b-54389d7de06f (578ba482-23cc-4bd9-8b8b-54389d7de06f): created successfully
Feb 27 02:04:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e837f8c-a84b-4626-97ac-65130e7f84a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Flow 'volume_create_manager' (781a8708-3f3e-4b0f-bf9b-52fdbf12b893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:26 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-42902710-2358-4f36-bd9b-6ebdc7231d19 tempest-VolumesListAdminTestJSON-755905512 None] Created volume successfully.
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Acquiring lock "cinder-578ba482-23cc-4bd9-8b8b-54389d7de06f-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Lock "cinder-578ba482-23cc-4bd9-8b8b-54389d7de06f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Acquiring lock "cinder-quobyte-578ba482-23cc-4bd9-8b8b-54389d7de06f" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Lock "cinder-quobyte-578ba482-23cc-4bd9-8b8b-54389d7de06f" acquired by "delete_volume" :: waited 0.021s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d966706-b9de-4271-9ce3-be162ad29c87]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "cinder-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "cinder-quobyte-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-quobyte-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78d934b-cdb4-4fdd-8725-20712e9222bb]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:27 devstack sudo[86480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f
Feb 27 02:04:27 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:27 devstack sudo[86482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb
Feb 27 02:04:27 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:28 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f" returned: 0 in 0.986s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:28 devstack sudo[86490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f
Feb 27 02:04:28 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:28 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb" returned: 0 in 0.906s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:28 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb
Feb 27 02:04:28 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:29 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-578ba482-23cc-4bd9-8b8b-54389d7de06f" returned: 0 in 0.592s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Lock "cinder-quobyte-578ba482-23cc-4bd9-8b8b-54389d7de06f" released by "delete_volume" :: held 1.617s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Created reservations ['7a4e36c2-6661-44fc-96c0-f4bc46d4d74c', 'fda10dcd-f951-4997-8950-6bf9dbe49eeb', 'e8b3e0e2-7383-445e-b9a6-76fd16a0771e', '8c747c64-6390-494e-a13c-6e2822459037'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:29 devstack sudo[86496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:29 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:29 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb" returned: 0 in 0.730s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-quobyte-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb" released by "delete_volume" :: held 1.677s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Created reservations ['70f85d31-81af-48a8-b1be-aa573047b373', '17fbc82c-97ac-40d3-b8a1-32f94dc90977', 'c90678eb-441d-4330-80fc-4fe53a9af3ba', 'd45776b3-40ae-4017-8830-597833ffa0eb'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:29 devstack sudo[86498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:29 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:29 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.672s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:29 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Deleted volume successfully.
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-dc9deb9f-8033-408e-a982-09181d150e6d tempest-VolumesListAdminTestJSON-755905512 None] Lock "cinder-578ba482-23cc-4bd9-8b8b-54389d7de06f-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "cinder-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "cinder-quobyte-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-quobyte-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:30 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bbe309-49b8-4462-ba6d-9d057e2d791f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:30 devstack sudo[86502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9
Feb 27 02:04:30 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:30 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.721s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:30 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:30 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Deleted volume successfully.
Feb 27 02:04:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e8343f71-3359-47ba-9be1-7b149678a07d tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-1a2a7564-8e88-4bfb-b96b-15ca61f20cdb-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:30 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9" returned: 0 in 0.575s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:30 devstack sudo[86508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9
Feb 27 02:04:30 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:31 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9" returned: 0 in 0.513s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-quobyte-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9" released by "delete_volume" :: held 1.129s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Created reservations ['53c8619a-e8a1-4cd5-ad2b-6b3a1e44f57b', 'c4fbb851-2f77-456d-81e6-35d282d48246', 'aefe805c-95e2-477a-a08a-9f46624ffba3', '065b75ec-72e8-4103-8704-3bcc8f118aba'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:31 devstack sudo[86511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:31 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:31 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.426s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:31 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Deleted volume successfully.
Feb 27 02:04:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6bead636-cfaf-4322-8bfe-cbcef6b26fcb tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-cb42c2ff-52a6-4bdf-ab9a-1b728394ebe9-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "cinder-85088490-e05a-4821-afe3-dbae4615c8cd-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-85088490-e05a-4821-afe3-dbae4615c8cd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "cinder-quobyte-85088490-e05a-4821-afe3-dbae4615c8cd" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-quobyte-85088490-e05a-4821-afe3-dbae4615c8cd" acquired by "delete_volume" :: waited 0.021s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[870aff00-971c-4bd9-b027-bfb8b09b48ec]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:32 devstack sudo[86515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd
Feb 27 02:04:32 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:32 devstack sudo[86519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:32 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:33 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.685s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:33 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd" returned: 0 in 0.920s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:33 devstack sudo[86527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd
Feb 27 02:04:33 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:33 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-85088490-e05a-4821-afe3-dbae4615c8cd" returned: 0 in 0.554s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:33 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-quobyte-85088490-e05a-4821-afe3-dbae4615c8cd" released by "delete_volume" :: held 1.511s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:33 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Created reservations ['d3843761-327b-43c0-bb4b-4f44281a69c3', '65246b7b-783f-43f8-99c3-cb6d7f14bda7', 'e1641b43-1f86-47f2-8612-e2f915b24972', '82ecf0de-052b-4139-a617-617e37d8a58a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:34 devstack sudo[86530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:34 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:34 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.629s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:34 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:34 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Deleted volume successfully.
Feb 27 02:04:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8166c4e7-8ab7-4141-99da-57dfc615057c tempest-VolumesListAdminTestJSON-273175317 None] Lock "cinder-85088490-e05a-4821-afe3-dbae4615c8cd-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Flow 'volume_create_manager' (3e6d1ed1-6df9-486d-b7a9-5680af05d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8512acf5-345a-4fde-91de-a4f0f94aefab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8512acf5-345a-4fde-91de-a4f0f94aefab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2140868868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d65a58-5948-4d87-9f1d-26a4cbc0ba3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b3c8dd39542489ac5dab39a4b5749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:35Z,use_quota=True,user_id='1b1dedcf3d2b45fb869eac7f52dbbfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75096ec-8a89-4e4a-a725-57b9cb477dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75096ec-8a89-4e4a-a725-57b9cb477dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7609b332-c4cc-4ed9-b8a8-a6f5aa37cec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7609b332-c4cc-4ed9-b8a8-a6f5aa37cec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d65a58-5948-4d87-9f1d-26a4cbc0ba3a', 'volume_name': 'volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e59153-c4c5-4019-ae6e-32807c1cbdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e59153-c4c5-4019-ae6e-32807c1cbdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da139c6-9617-497d-8aa6-50224f0ef819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Volume 71d65a58-5948-4d87-9f1d-26a4cbc0ba3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a', 'volume_size': 1}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2140868868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d65a58-5948-4d87-9f1d-26a4cbc0ba3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6b3c8dd39542489ac5dab39a4b5749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:35Z,use_quota=True,user_id='1b1dedcf3d2b45fb869eac7f52dbbfe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Creating volume 71d65a58-5948-4d87-9f1d-26a4cbc0ba3a {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:04:35 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:35 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a 1073741824
Feb 27 02:04:35 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Flow 'volume_create_manager' (9d7e4416-a0eb-4464-87f0-74c019e29745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9ea1e4-1fe0-4d83-8ce8-35b3d34b17fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9ea1e4-1fe0-4d83-8ce8-35b3d34b17fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-200026221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca61971-2f77-4ab7-a92c-9efee711ff36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578397ec7d54f058abbe74f34da3a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:36Z,use_quota=True,user_id='efc5be85e3d0450792d8302cbe728fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931a69c8-18c2-42ba-a147-8cc4ef7dccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931a69c8-18c2-42ba-a147-8cc4ef7dccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0420a6-fa32-498b-a8aa-b19ddfd9c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0420a6-fa32-498b-a8aa-b19ddfd9c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca61971-2f77-4ab7-a92c-9efee711ff36', 'volume_name': 'volume-9ca61971-2f77-4ab7-a92c-9efee711ff36', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdbc990-3406-406e-b1a6-c12d04791b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdbc990-3406-406e-b1a6-c12d04791b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c19315-dc92-4619-acab-b74b3930df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:35 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Volume 9ca61971-2f77-4ab7-a92c-9efee711ff36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca61971-2f77-4ab7-a92c-9efee711ff36', 'volume_size': 1}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:35 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a 1073741824" returned: 0 in 0.767s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:35 devstack sudo[86538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a
Feb 27 02:04:35 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:36 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" returned: 0 in 0.518s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-200026221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca61971-2f77-4ab7-a92c-9efee711ff36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5578397ec7d54f058abbe74f34da3a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:36Z,use_quota=True,user_id='efc5be85e3d0450792d8302cbe728fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Creating volume 9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:04:36 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da139c6-9617-497d-8aa6-50224f0ef819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:36 devstack sudo[86541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 1073741824
Feb 27 02:04:36 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286204a2-e823-45b3-9c3c-0758589ac488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:36 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Volume volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a (71d65a58-5948-4d87-9f1d-26a4cbc0ba3a): created successfully
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286204a2-e823-45b3-9c3c-0758589ac488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Flow 'volume_create_manager' (3e6d1ed1-6df9-486d-b7a9-5680af05d484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:36 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-7fccdcb8-ae3c-4845-a141-92e284c13395 req-568e42e6-34ab-47bd-8991-f6b1c3eb03d2 tempest-VolumesSnapshotsTestJSON-446037458 None] Created volume successfully.
Feb 27 02:04:37 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 1073741824" returned: 0 in 0.864s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:37 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36
Feb 27 02:04:37 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:38 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36" returned: 0 in 0.648s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.492s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c19315-dc92-4619-acab-b74b3930df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca61971-2f77-4ab7-a92c-9efee711ff36', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36719e55-8732-4430-aa5e-f43f17cb5ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Creating offline snapshot 62874940-bb9e-4d76-8f7d-a850369c9f18 of volume 71d65a58-5948-4d87-9f1d-26a4cbc0ba3a {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:04:38 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Volume volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 (9ca61971-2f77-4ab7-a92c-9efee711ff36): created successfully
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36719e55-8732-4430-aa5e-f43f17cb5ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Flow 'volume_create_manager' (9d7e4416-a0eb-4464-87f0-74c019e29745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42086f3-c2a1-484f-add5-44e9ffdd8a8e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:38 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0413b018-f8de-45ee-9c5f-55ab76dc0459 tempest-VolumesActionsTest-1083006709 None] Created volume successfully.
Feb 27 02:04:38 devstack sudo[86550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a
Feb 27 02:04:38 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:38 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" returned: 0 in 0.723s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:38 devstack sudo[86567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 1G
Feb 27 02:04:38 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:39 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 1G" returned: 0 in 0.829s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:39 devstack sudo[86610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18
Feb 27 02:04:39 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:40 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18" returned: 0 in 0.574s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:40 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 is being set with open permissions: ugo+rw
Feb 27 02:04:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:40 devstack sudo[86618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18
Feb 27 02:04:40 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:40 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18" returned: 0 in 0.496s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:40 devstack sudo[86627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.info
Feb 27 02:04:40 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:41 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.info" returned: 0 in 0.561s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:41 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.info is being set with open permissions: ugo+rw
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:41 devstack sudo[86630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.info
Feb 27 02:04:41 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Flow 'volume_create_manager' (d99bda07-1f08-4136-a2c0-1a0c0aa4608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3aa0fc-c41a-463c-adb1-12701232b6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3aa0fc-c41a-463c-adb1-12701232b6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1579234900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a195661a-3e01-4ef9-b093-579a969eddaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e808dd81895492b8abe516c1dfaa548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:41Z,use_quota=True,user_id='d398e89cefa74021be867002176441a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74ed2a0-1523-4a30-80e3-0f512f59a9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74ed2a0-1523-4a30-80e3-0f512f59a9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7afe02-5749-4975-9ae9-dc4896ed7d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.image.glance [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Creating Keystone auth plugin from conf {{(pid=83140) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7afe02-5749-4975-9ae9-dc4896ed7d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a195661a-3e01-4ef9-b093-579a969eddaa', 'volume_name': 'volume-a195661a-3e01-4ef9-b093-579a969eddaa', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7591e17fd0>}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94252bd5-adb9-4650-b63e-49569b899e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94252bd5-adb9-4650-b63e-49569b899e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c62209-dbc4-46a8-834f-8c20b38ea5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:41 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Volume a195661a-3e01-4ef9-b093-579a969eddaa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a195661a-3e01-4ef9-b093-579a969eddaa', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7591e17fd0>}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Trying to clone a195661a-3e01-4ef9-b093-579a969eddaa from image 6dca12c4-e54e-4172-8642-cefd07ec0f99 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]). {{(pid=83140) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 02:04:41 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a864be93-9b83-4f5f-a708-a1e278df8980]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:41 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.info" returned: 0 in 0.578s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.868s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:41 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-83920376-9498-4847-9586-aeaca479c15d req-8860c08f-7607-44aa-b591-f2418816f111 tempest-VolumesSnapshotsTestJSON-446037458 None] Create snapshot completed successfully
Feb 27 02:04:41 devstack sudo[86634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD
Feb 27 02:04:41 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Acquiring lock "cinder-62874940-bb9e-4d76-8f7d-a850369c9f18-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-62874940-bb9e-4d76-8f7d-a850369c9f18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Acquiring lock "cinder-quobyte-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-quobyte-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Acquiring lock "cinder-quobyte-62874940-bb9e-4d76-8f7d-a850369c9f18" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-quobyte-62874940-bb9e-4d76-8f7d-a850369c9f18" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Deleting offline snapshot 62874940-bb9e-4d76-8f7d-a850369c9f18 of volume 71d65a58-5948-4d87-9f1d-26a4cbc0ba3a {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] snapshot_file for this snap is: volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed252297-3116-4388-8162-3642571f0a9c]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:42 devstack sudo[86637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18
Feb 27 02:04:42 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:42 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD" returned: 0 in 0.609s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Temporary image 6dca12c4-e54e-4172-8642-cefd07ec0f99 is fetched for user d398e89cefa74021be867002176441a9. {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6473d602-5a8c-4946-94ad-2b17d4f7a736]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:42 devstack sudo[86641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD
Feb 27 02:04:42 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:42 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18" returned: 0 in 0.642s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62b2c19-73bc-4440-a04c-0d5a6704c516]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:43 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a
Feb 27 02:04:43 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:43 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1579234900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a195661a-3e01-4ef9-b093-579a969eddaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e808dd81895492b8abe516c1dfaa548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:41Z,use_quota=True,user_id='d398e89cefa74021be867002176441a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Creating volume a195661a-3e01-4ef9-b093-579a969eddaa {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:04:43 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:43 devstack sudo[86656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa 1073741824
Feb 27 02:04:43 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:43 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" returned: 0 in 0.599s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:43 devstack sudo[86664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18
Feb 27 02:04:43 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:43 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa 1073741824" returned: 0 in 0.664s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:43 devstack sudo[86666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa
Feb 27 02:04:43 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:44 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18" returned: 0 in 0.681s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:44 devstack sudo[86691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18
Feb 27 02:04:44 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:44 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa" returned: 0 in 0.786s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:04:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:44 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Attempting download of 6dca12c4-e54e-4172-8642-cefd07ec0f99 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}])) to volume a195661a-3e01-4ef9-b093-579a969eddaa. {{(pid=83140) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 02:04:44 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5da412f-e029-46ab-99fd-70f661802b31]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_8s1jclyd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:44 devstack sudo[86700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_8s1jclyd
Feb 27 02:04:44 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:45 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a.62874940-bb9e-4d76-8f7d-a850369c9f18" returned: 0 in 0.982s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-quobyte-62874940-bb9e-4d76-8f7d-a850369c9f18" released by "_delete_snapshot" :: held 2.988s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-quobyte-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" released by "delete_snapshot" :: held 3.007s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG cinder.quota [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Created reservations ['6f1fac87-5910-4846-ac24-2f118f4b771d', 'dab2f3d4-c6e5-4bf0-ad4f-c8af26f619ab', '2f17981c-9d87-40c1-b417-c689867e460a', 'b51dbebb-6fb8-44a5-9456-05f11c0b9e14'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:45 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Delete snapshot completed successfully.
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-0aff2847-00e1-48d3-8b86-b304c475e56e req-3aa1b908-0c70-4383-a62e-077759ad3cc4 tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-62874940-bb9e-4d76-8f7d-a850369c9f18-delete_snapshot" released by "delete_snapshot" :: held 3.158s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Acquiring lock "cinder-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Acquiring lock "cinder-quobyte-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:45 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-quobyte-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" acquired by "delete_volume" :: waited 0.022s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_8s1jclyd" returned: 0 in 1.178s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_8s1jclyd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[23617c1e-ef39-4588-9307-fb6751551681]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:46 devstack sudo[86706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_8s1jclyd
Feb 27 02:04:46 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:46 devstack sudo[86707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a
Feb 27 02:04:46 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:46 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_8s1jclyd" returned: 1 in 0.931s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_8s1jclyd' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:04:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbd82e2-daaf-45b1-af7c-2d0aa59e974f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:46 devstack sudo[86722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD
Feb 27 02:04:47 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:47 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" returned: 0 in 1.195s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:47 devstack sudo[86730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a
Feb 27 02:04:47 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:47 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:47 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] 6dca12c4-e54e-4172-8642-cefd07ec0f99 was qcow2, converting to raw {{(pid=83140) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 02:04:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:47 devstack sudo[86739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa
Feb 27 02:04:47 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:47 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" returned: 0 in 0.696s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-quobyte-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a" released by "delete_volume" :: held 2.018s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:47 devstack cinder-volume[83140]: DEBUG cinder.quota [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Created reservations ['c1bc6e05-4fa0-4fbf-86e4-b4036bb3f384', 'a8d44949-80f3-4010-b222-e5b110deb6fd', '9112e05d-a318-4e79-b9e6-481de4d8b844', '5b5efa94-c874-493f-bf9f-388881d640e8'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:48 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:48 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:48 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.677s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:48 devstack cinder-volume[83140]: DEBUG cinder.manager [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Deleted volume successfully.
Feb 27 02:04:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [req-ea586a24-417d-4217-9a00-627a920c1764 req-f6c1329e-f643-458c-a459-f81da0d2ab6f tempest-VolumesSnapshotsTestJSON-446037458 None] Lock "cinder-71d65a58-5948-4d87-9f1d-26a4cbc0ba3a-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:49 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa" returned: 0 in 1.641s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:49 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_vgbi8igldevstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:04:49 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Converted 112.00 MB image at 68.21 MB/s
Feb 27 02:04:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:49 devstack sudo[86752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa 1G
Feb 27 02:04:49 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:49 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa 1G" returned: 0 in 0.686s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:50 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3da6e3a-4233-43d1-9073-12732475bda7]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:50 devstack sudo[86758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa
Feb 27 02:04:50 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:50 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa" returned: 0 in 0.868s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:51 devstack sudo[86765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa
Feb 27 02:04:51 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:51 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa" returned: 1 in 0.620s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Downloaded image 6dca12c4-e54e-4172-8642-cefd07ec0f99 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}])) to volume a195661a-3e01-4ef9-b093-579a969eddaa successfully. {{(pid=83140) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Temporary image 6dca12c4-e54e-4172-8642-cefd07ec0f99 for user d398e89cefa74021be867002176441a9 is deleted. {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Marking volume a195661a-3e01-4ef9-b093-579a969eddaa as bootable. {{(pid=83140) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Copying metadata from image 6dca12c4-e54e-4172-8642-cefd07ec0f99 to a195661a-3e01-4ef9-b093-579a969eddaa. {{(pid=83140) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Creating volume glance metadata for volume a195661a-3e01-4ef9-b093-579a969eddaa backed by image 6dca12c4-e54e-4172-8642-cefd07ec0f99 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83140) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c62209-dbc4-46a8-834f-8c20b38ea5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a195661a-3e01-4ef9-b093-579a969eddaa', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7591e17fd0>}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ab7ea6-e214-4cb7-836e-c663d443d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:04:51 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Volume volume-a195661a-3e01-4ef9-b093-579a969eddaa (a195661a-3e01-4ef9-b093-579a969eddaa): created successfully
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ab7ea6-e214-4cb7-836e-c663d443d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:04:51 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Flow 'volume_create_manager' (d99bda07-1f08-4136-a2c0-1a0c0aa4608c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:04:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8dfd25b8-9088-40e8-804b-7c1a357f7939 tempest-VolumesImageMetadata-602092720 None] Created volume successfully.
Feb 27 02:04:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Acquiring lock "cinder-a195661a-3e01-4ef9-b093-579a969eddaa-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Lock "cinder-a195661a-3e01-4ef9-b093-579a969eddaa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Acquiring lock "cinder-quobyte-a195661a-3e01-4ef9-b093-579a969eddaa" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Lock "cinder-quobyte-a195661a-3e01-4ef9-b093-579a969eddaa" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:52 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c79863-7a3e-4e08-8423-476e2e448953]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:04:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:53 devstack sudo[86800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa
Feb 27 02:04:53 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:53 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa" returned: 0 in 0.942s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:53 devstack sudo[86804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa
Feb 27 02:04:53 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-379de52a-b3f3-4572-9b24-130d9ff5bbb7 tempest-VolumesActionsTest-1083006709 None] Acquiring lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36" by "attach_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-379de52a-b3f3-4572-9b24-130d9ff5bbb7 tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36" acquired by "attach_volume" :: waited 0.045s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-379de52a-b3f3-4572-9b24-130d9ff5bbb7 tempest-VolumesActionsTest-1083006709 None] Attaching volume 9ca61971-2f77-4ab7-a92c-9efee711ff36 to instance bf988315-ff04-4461-b531-e7de01a5861d at mountpoint /dev/vdb on host None.
Feb 27 02:04:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-379de52a-b3f3-4572-9b24-130d9ff5bbb7 tempest-VolumesActionsTest-1083006709 None] Attach volume completed successfully.
Feb 27 02:04:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-379de52a-b3f3-4572-9b24-130d9ff5bbb7 tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36" released by "attach_volume" :: held 0.137s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:55 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa" returned: 1 in 1.362s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:04:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:55 devstack sudo[86809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa
Feb 27 02:04:55 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3ca863be-520d-42d9-ac3a-d68cd1101a5f tempest-VolumesActionsTest-1083006709 None] Acquiring lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36-detach_volume" by "detach_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:04:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3ca863be-520d-42d9-ac3a-d68cd1101a5f tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:04:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3ca863be-520d-42d9-ac3a-d68cd1101a5f tempest-VolumesActionsTest-1083006709 None] Detaching volume 9ca61971-2f77-4ab7-a92c-9efee711ff36 from instance bf988315-ff04-4461-b531-e7de01a5861d.
Feb 27 02:04:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3ca863be-520d-42d9-ac3a-d68cd1101a5f tempest-VolumesActionsTest-1083006709 None] Detach volume completed successfully.
Feb 27 02:04:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3ca863be-520d-42d9-ac3a-d68cd1101a5f tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:56 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a195661a-3e01-4ef9-b093-579a969eddaa" returned: 0 in 1.406s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:56 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Lock "cinder-quobyte-a195661a-3e01-4ef9-b093-579a969eddaa" released by "delete_volume" :: held 3.842s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:04:56 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Created reservations ['53d17e90-a60a-4853-9ce9-7b18829c91cf', '34d65237-95b3-4042-b0c4-04d09a3772f9', 'b5e90d2e-524e-4873-9c95-681e60b3ff98', 'f624338d-8ee7-4150-a11a-21f037663915'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:04:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:04:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:04:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:04:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:04:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:04:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:04:56 devstack sudo[86828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:04:56 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:04:57 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root
Feb 27 02:04:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.640s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:04:57 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:04:57 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Deleted volume successfully.
Feb 27 02:04:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-32fd7999-631e-4d64-a19a-a5e66cb619c4 tempest-VolumesImageMetadata-602092720 None] Lock "cinder-a195661a-3e01-4ef9-b093-579a969eddaa-delete_volume" released by "delete_volume" :: held 4.700s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Flow 'volume_create_manager' (250c9393-d623-4783-9e8f-33bb365e974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a560499-db3d-45c1-ba36-dd74e3722c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a560499-db3d-45c1-ba36-dd74e3722c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-334316061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738989cf-2f75-4ea3-800b-f2ecbdfc174d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec223d51d35544deb30e55c6a23f70d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:01Z,use_quota=True,user_id='43f167dfef4e4ad88af2ed1e7bea9c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeefa86-f117-4c61-adfb-e456441cbe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeefa86-f117-4c61-adfb-e456441cbe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3944efa9-5a53-4e0b-8a3d-70869422f509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3944efa9-5a53-4e0b-8a3d-70869422f509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738989cf-2f75-4ea3-800b-f2ecbdfc174d', 'volume_name': 'volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743dc3e2-ceef-4b9b-b0b5-eeb05de6096d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743dc3e2-ceef-4b9b-b0b5-eeb05de6096d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd09d7f-1af8-4ed3-8253-20edaee60f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:00 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Volume 738989cf-2f75-4ea3-800b-f2ecbdfc174d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d', 'volume_size': 1}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-334316061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738989cf-2f75-4ea3-800b-f2ecbdfc174d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec223d51d35544deb30e55c6a23f70d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:01Z,use_quota=True,user_id='43f167dfef4e4ad88af2ed1e7bea9c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Creating volume 738989cf-2f75-4ea3-800b-f2ecbdfc174d {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:00 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:00 devstack sudo[86862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d 1073741824
Feb 27 02:05:00 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:01 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d 1073741824" returned: 0 in 0.678s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:01 devstack sudo[86867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d
Feb 27 02:05:01 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:02 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d" returned: 0 in 0.805s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd09d7f-1af8-4ed3-8253-20edaee60f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850e6876-21de-47c0-b2dc-c5d509c1ff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:02 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Volume volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d (738989cf-2f75-4ea3-800b-f2ecbdfc174d): created successfully
Feb 27 02:05:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850e6876-21de-47c0-b2dc-c5d509c1ff9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Flow 'volume_create_manager' (250c9393-d623-4783-9e8f-33bb365e974e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:02 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3e55348a-6ed2-4478-a9cd-27dde726dc36 tempest-SnapshotMetadataTestJSON-796155893 None] Created volume successfully.
Feb 27 02:05:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Creating offline snapshot f57729d0-fdc2-451a-8f0c-4050cb13c6cd of volume 738989cf-2f75-4ea3-800b-f2ecbdfc174d {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:05:03 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd5a7b-8e8b-43d1-b50c-4ffdb54abeee]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:03 devstack sudo[86897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d
Feb 27 02:05:03 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:04 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d" returned: 0 in 1.084s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:04 devstack sudo[86903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd 1G
Feb 27 02:05:04 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:05 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd 1G" returned: 0 in 1.069s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:05 devstack sudo[86911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd
Feb 27 02:05:05 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Flow 'volume_create_manager' (7763a355-be6a-4264-9b46-0b2922796e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11aa4bea-d09b-4a01-90e9-10b5a93c03ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11aa4bea-d09b-4a01-90e9-10b5a93c03ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-186140843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3ab8d7-6836-430b-91aa-f73542f9e87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afba1b4d073404fb8d7b2c1d34f9fa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:06Z,use_quota=True,user_id='5fb338cbe563456397d9c7232e570b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa0a217-3582-48f5-9022-8e6bd6532aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa0a217-3582-48f5-9022-8e6bd6532aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b22305c-ea87-427a-9201-ad4f687f9dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b22305c-ea87-427a-9201-ad4f687f9dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db3ab8d7-6836-430b-91aa-f73542f9e87c', 'volume_name': 'volume-db3ab8d7-6836-430b-91aa-f73542f9e87c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f360ebd-3b1a-422f-b269-7b7bf19c805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f360ebd-3b1a-422f-b269-7b7bf19c805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3460a779-8f56-4201-a54f-ba4c7b23fa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:05 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Volume db3ab8d7-6836-430b-91aa-f73542f9e87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db3ab8d7-6836-430b-91aa-f73542f9e87c', 'volume_size': 1}
Feb 27 02:05:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:06 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd" returned: 0 in 0.918s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:06 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd is being set with open permissions: ugo+rw
Feb 27 02:05:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:06 devstack sudo[86916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd
Feb 27 02:05:06 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:06 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd" returned: 0 in 0.463s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:06 devstack sudo[86925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.info
Feb 27 02:05:06 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:07 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.info" returned: 0 in 0.618s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:07 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.info is being set with open permissions: ugo+rw
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:07 devstack sudo[86942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.info
Feb 27 02:05:07 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:07 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.info" returned: 0 in 0.504s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.743s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.883s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-186140843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3ab8d7-6836-430b-91aa-f73542f9e87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afba1b4d073404fb8d7b2c1d34f9fa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:06Z,use_quota=True,user_id='5fb338cbe563456397d9c7232e570b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Creating volume db3ab8d7-6836-430b-91aa-f73542f9e87c {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:07 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:07 devstack sudo[86946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c 1073741824
Feb 27 02:05:07 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d8aeb900-8d0f-49dd-8049-774d098148b1 tempest-SnapshotMetadataTestJSON-796155893 None] Create snapshot completed successfully
Feb 27 02:05:08 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c 1073741824" returned: 0 in 0.806s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:08 devstack sudo[86952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c
Feb 27 02:05:08 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Acquiring lock "cinder-f57729d0-fdc2-451a-8f0c-4050cb13c6cd-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-f57729d0-fdc2-451a-8f0c-4050cb13c6cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Acquiring lock "cinder-quobyte-738989cf-2f75-4ea3-800b-f2ecbdfc174d" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-quobyte-738989cf-2f75-4ea3-800b-f2ecbdfc174d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Acquiring lock "cinder-quobyte-f57729d0-fdc2-451a-8f0c-4050cb13c6cd" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-quobyte-f57729d0-fdc2-451a-8f0c-4050cb13c6cd" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Deleting offline snapshot f57729d0-fdc2-451a-8f0c-4050cb13c6cd of volume 738989cf-2f75-4ea3-800b-f2ecbdfc174d {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] snapshot_file for this snap is: volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dafe971-9589-45af-9b52-aca8c453f176]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:09 devstack sudo[86962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd
Feb 27 02:05:09 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:09 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c" returned: 0 in 0.633s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3460a779-8f56-4201-a54f-ba4c7b23fa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3ab8d7-6836-430b-91aa-f73542f9e87c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4400820-c566-4bde-8f91-1e62fb206ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:09 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Volume volume-db3ab8d7-6836-430b-91aa-f73542f9e87c (db3ab8d7-6836-430b-91aa-f73542f9e87c): created successfully
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4400820-c566-4bde-8f91-1e62fb206ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Flow 'volume_create_manager' (7763a355-be6a-4264-9b46-0b2922796e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:09 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e1e7604d-8507-4500-b3b1-6b4828e2b8e8 tempest-VolumeQuotasNegativeTestJSON-638472799 None] Created volume successfully.
Feb 27 02:05:09 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd" returned: 0 in 0.708s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[68592f96-ee73-421b-87c6-78a837c14928]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:09 devstack sudo[86969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d
Feb 27 02:05:09 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:10 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d" returned: 0 in 0.650s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:10 devstack sudo[86974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd
Feb 27 02:05:10 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Acquiring lock "cinder-db3ab8d7-6836-430b-91aa-f73542f9e87c-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "cinder-db3ab8d7-6836-430b-91aa-f73542f9e87c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Acquiring lock "cinder-quobyte-db3ab8d7-6836-430b-91aa-f73542f9e87c" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "cinder-quobyte-db3ab8d7-6836-430b-91aa-f73542f9e87c" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b300acb-9d18-4ab7-8eaa-a4f6a4421ec0]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:11 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd" returned: 0 in 0.835s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:11 devstack sudo[87029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd
Feb 27 02:05:11 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:11 devstack sudo[87027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c
Feb 27 02:05:11 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:11 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d.f57729d0-fdc2-451a-8f0c-4050cb13c6cd" returned: 0 in 0.501s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-quobyte-f57729d0-fdc2-451a-8f0c-4050cb13c6cd" released by "_delete_snapshot" :: held 2.767s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-quobyte-738989cf-2f75-4ea3-800b-f2ecbdfc174d" released by "delete_snapshot" :: held 2.784s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:11 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c" returned: 0 in 0.590s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:11 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Created reservations ['35c0d8f6-0d44-4e1f-aef1-48be315988ba', 'd7070a4d-7403-40a0-91bf-c1a48e10604e', '58b1d19e-ce89-47ed-8ffd-5fd0d7c16bc6', '03930ede-7aa9-43a2-9327-62acf4eb2162'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:05:11 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c
Feb 27 02:05:11 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:11 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Delete snapshot completed successfully.
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d8f4073-8942-4ee6-b8a2-18505dbee997 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-f57729d0-fdc2-451a-8f0c-4050cb13c6cd-delete_snapshot" released by "delete_snapshot" :: held 2.976s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Acquiring lock "cinder-738989cf-2f75-4ea3-800b-f2ecbdfc174d-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-738989cf-2f75-4ea3-800b-f2ecbdfc174d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Acquiring lock "cinder-quobyte-738989cf-2f75-4ea3-800b-f2ecbdfc174d" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-quobyte-738989cf-2f75-4ea3-800b-f2ecbdfc174d" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2047a7e-b8e0-4efd-aa2b-6b945d672485]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:12 devstack sudo[87046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d
Feb 27 02:05:12 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Flow 'volume_create_manager' (6946c71c-01b7-42b7-81a0-2bb8388516fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22fb0a9-907d-44de-b5de-3dc79b3475e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22fb0a9-907d-44de-b5de-3dc79b3475e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1583913948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768a0722-4fec-4ad5-b41c-be8d4cdf4fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ededf2b2c8ea45b3b80d2e939a1cac38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:13Z,use_quota=True,user_id='9006c37dd55d48638086e2ed0d1fcfbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1df943-303d-47ac-a7fa-62350d89ae4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1df943-303d-47ac-a7fa-62350d89ae4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab3fd50-ac6c-4f87-9ca0-fe40dcc00011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab3fd50-ac6c-4f87-9ca0-fe40dcc00011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768a0722-4fec-4ad5-b41c-be8d4cdf4fba', 'volume_name': 'volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177bb0e7-71eb-4b7b-ba25-bf4a27d4c5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177bb0e7-71eb-4b7b-ba25-bf4a27d4c5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64c33b6-59ba-44bd-9e78-32d0485171b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:12 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Volume 768a0722-4fec-4ad5-b41c-be8d4cdf4fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba', 'volume_size': 1}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1583913948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768a0722-4fec-4ad5-b41c-be8d4cdf4fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ededf2b2c8ea45b3b80d2e939a1cac38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:13Z,use_quota=True,user_id='9006c37dd55d48638086e2ed0d1fcfbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Creating volume 768a0722-4fec-4ad5-b41c-be8d4cdf4fba {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:12 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:12 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-db3ab8d7-6836-430b-91aa-f73542f9e87c" returned: 0 in 0.825s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:12 devstack sudo[87049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba 1073741824
Feb 27 02:05:12 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "cinder-quobyte-db3ab8d7-6836-430b-91aa-f73542f9e87c" released by "delete_volume" :: held 1.440s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Created reservations ['d3a3bdc3-94c6-430a-9a78-94be88db8b2e', '13d409dc-b3a9-4c54-84d7-6a6e41bf400d', '1caf6672-b38b-4518-9ff1-3d5de13dc552', '6772a20c-5264-4428-9ef9-9edb506d1a4c'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:12 devstack sudo[87052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:05:12 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:13 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d" returned: 0 in 0.658s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:13 devstack sudo[87057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d
Feb 27 02:05:13 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:13 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba 1073741824" returned: 0 in 0.715s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:13 devstack sudo[87063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba
Feb 27 02:05:13 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:13 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.757s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:05:13 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Deleted volume successfully.
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-93cb73ae-6bb8-477d-b80d-6264dd0bc82c tempest-VolumeQuotasNegativeTestJSON-638472799 None] Lock "cinder-db3ab8d7-6836-430b-91aa-f73542f9e87c-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:13 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-738989cf-2f75-4ea3-800b-f2ecbdfc174d" returned: 0 in 0.778s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-quobyte-738989cf-2f75-4ea3-800b-f2ecbdfc174d" released by "delete_volume" :: held 1.500s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Created reservations ['08fdc5ba-d2a6-4388-89ec-2f04c862d591', '3bd41812-dfe2-461f-9247-0e8a7daa2969', 'b76eec01-dde4-44c7-adbb-dd6b366c6b88', 'b31e8e0d-d291-46fd-b1a0-5f8122ef86a1'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:14 devstack sudo[87066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:05:14 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:14 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba" returned: 0 in 0.686s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64c33b6-59ba-44bd-9e78-32d0485171b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41df095-3007-47a6-8a79-88efba5cbf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:14 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Volume volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba (768a0722-4fec-4ad5-b41c-be8d4cdf4fba): created successfully
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41df095-3007-47a6-8a79-88efba5cbf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Flow 'volume_create_manager' (6946c71c-01b7-42b7-81a0-2bb8388516fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:14 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-294fda27-f665-46f1-920f-9096306b3cd9 tempest-ServersNegativeTestJSON-1746894891 None] Created volume successfully.
Feb 27 02:05:14 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.644s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:05:14 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Deleted volume successfully.
Feb 27 02:05:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02d7e796-2b9c-4cab-899f-62e13a8ad9a6 tempest-SnapshotMetadataTestJSON-796155893 None] Lock "cinder-738989cf-2f75-4ea3-800b-f2ecbdfc174d-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Flow 'volume_create_manager' (3bcbfcff-4a84-4100-be7d-aff6f9c5c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e87253-4d8c-4daa-b243-b64edbabebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e87253-4d8c-4daa-b243-b64edbabebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-329613120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999b584a-4356-4753-8986-f0852c4713b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ededf2b2c8ea45b3b80d2e939a1cac38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:16Z,use_quota=True,user_id='9006c37dd55d48638086e2ed0d1fcfbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305be2ed-9fe9-4053-8c8a-256338f25a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305be2ed-9fe9-4053-8c8a-256338f25a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420b76dc-a1e9-40f2-8347-343c520c8332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420b76dc-a1e9-40f2-8347-343c520c8332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999b584a-4356-4753-8986-f0852c4713b8', 'volume_name': 'volume-999b584a-4356-4753-8986-f0852c4713b8', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd647c57-f719-42b4-9331-cfb4c40bac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd647c57-f719-42b4-9331-cfb4c40bac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dc6e1c-1eb9-4fcd-809e-28a2fe2032fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:16 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Volume 999b584a-4356-4753-8986-f0852c4713b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999b584a-4356-4753-8986-f0852c4713b8', 'volume_size': 1}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-329613120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999b584a-4356-4753-8986-f0852c4713b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ededf2b2c8ea45b3b80d2e939a1cac38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:16Z,use_quota=True,user_id='9006c37dd55d48638086e2ed0d1fcfbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Creating volume 999b584a-4356-4753-8986-f0852c4713b8 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:16 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:16 devstack sudo[87099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8 1073741824
Feb 27 02:05:16 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Flow 'volume_create_manager' (ee5a3e5e-5356-4e06-939e-3ca6a5a402f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7692e72d-c130-4c2c-8175-c97eff172c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7692e72d-c130-4c2c-8175-c97eff172c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1466629748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d0f15b-a98e-457f-ab8c-0d0aff6b7418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6584e3f6a8cb4fb6ab4e58e1c90a369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:18Z,use_quota=True,user_id='70992425e69042498a225f62546c870c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:18 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36086f78-4698-4345-a639-f24e9f41c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36086f78-4698-4345-a639-f24e9f41c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d96c40-3dde-4b52-a479-8a468122488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.image.glance [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Creating Keystone auth plugin from conf {{(pid=83140) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8 1073741824" returned: 0 in 1.569s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:18 devstack sudo[87105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8
Feb 27 02:05:18 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bd335ffa-0bed-4543-ad5e-889480301189 tempest-VolumesActionsTest-1083006709 None] Acquiring lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36" by "attach_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bd335ffa-0bed-4543-ad5e-889480301189 tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36" acquired by "attach_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:18 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bd335ffa-0bed-4543-ad5e-889480301189 tempest-VolumesActionsTest-1083006709 None] Attaching volume 9ca61971-2f77-4ab7-a92c-9efee711ff36 to instance b6b67d2f-293d-438f-9515-fc71d0b33b9d at mountpoint /dev/vdb on host None.
Feb 27 02:05:18 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bd335ffa-0bed-4543-ad5e-889480301189 tempest-VolumesActionsTest-1083006709 None] Attach volume completed successfully.
Feb 27 02:05:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bd335ffa-0bed-4543-ad5e-889480301189 tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36" released by "attach_volume" :: held 0.081s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d96c40-3dde-4b52-a479-8a468122488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17d0f15b-a98e-457f-ab8c-0d0aff6b7418', 'volume_name': 'volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7587a61060>}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd46a50f-7c92-4d6c-83ce-26b0513faa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd46a50f-7c92-4d6c-83ce-26b0513faa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e538ed0-1ab5-42fc-97fd-a68f9cd103ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Volume 17d0f15b-a98e-457f-ab8c-0d0aff6b7418: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7587a61060>}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Trying to clone 17d0f15b-a98e-457f-ab8c-0d0aff6b7418 from image 6dca12c4-e54e-4172-8642-cefd07ec0f99 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]). {{(pid=83140) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 02:05:19 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e568e792-fd36-4a1c-aa5e-a31d341480e3]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:19 devstack sudo[87109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD
Feb 27 02:05:19 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Flow 'volume_create_manager' (2ea3da2d-f1dc-4022-b881-986b6c3f1718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207004d1-162e-489b-b083-c0e6e9fe5a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:19 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207004d1-162e-489b-b083-c0e6e9fe5a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1370663671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9277a1-971a-422c-9304-1124b6e89267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20656085977743b29a477d885df800d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:20Z,use_quota=True,user_id='2ae354838037490daadf26b9d9c12137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e924ab05-3cb8-4dd7-8aa1-58af2f3f1f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e924ab05-3cb8-4dd7-8aa1-58af2f3f1f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68260d70-afc6-4b07-a8dd-28c1d59caa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68260d70-afc6-4b07-a8dd-28c1d59caa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9277a1-971a-422c-9304-1124b6e89267', 'volume_name': 'volume-7f9277a1-971a-422c-9304-1124b6e89267', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8ef77b-c7b7-4e47-bf3c-c4df9789289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8ef77b-c7b7-4e47-bf3c-c4df9789289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9059959f-2053-4d70-9859-4add4c7790be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Volume 7f9277a1-971a-422c-9304-1124b6e89267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9277a1-971a-422c-9304-1124b6e89267', 'volume_size': 1}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bbc590d5-2d3f-4e0b-83d4-fb7a27f81b4b tempest-VolumesActionsTest-1083006709 None] Acquiring lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36-detach_volume" by "detach_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8" returned: 0 in 1.242s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] <== create_volume: return (2915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.922s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1370663671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9277a1-971a-422c-9304-1124b6e89267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20656085977743b29a477d885df800d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:20Z,use_quota=True,user_id='2ae354838037490daadf26b9d9c12137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Creating volume 7f9277a1-971a-422c-9304-1124b6e89267 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:19 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bbc590d5-2d3f-4e0b-83d4-fb7a27f81b4b tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bbc590d5-2d3f-4e0b-83d4-fb7a27f81b4b tempest-VolumesActionsTest-1083006709 None] Detaching volume 9ca61971-2f77-4ab7-a92c-9efee711ff36 from instance b6b67d2f-293d-438f-9515-fc71d0b33b9d.
Feb 27 02:05:19 devstack sudo[87111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267 1073741824
Feb 27 02:05:19 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dc6e1c-1eb9-4fcd-809e-28a2fe2032fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999b584a-4356-4753-8986-f0852c4713b8', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e840a25-a1be-4cfa-be3d-54957e54e8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Volume volume-999b584a-4356-4753-8986-f0852c4713b8 (999b584a-4356-4753-8986-f0852c4713b8): created successfully
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e840a25-a1be-4cfa-be3d-54957e54e8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Flow 'volume_create_manager' (3bcbfcff-4a84-4100-be7d-aff6f9c5c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b61e6bb8-6882-4366-91cb-14883273232b tempest-ServersNegativeTestJSON-1746894891 None] Created volume successfully.
Feb 27 02:05:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bbc590d5-2d3f-4e0b-83d4-fb7a27f81b4b tempest-VolumesActionsTest-1083006709 None] Detach volume completed successfully.
Feb 27 02:05:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bbc590d5-2d3f-4e0b-83d4-fb7a27f81b4b tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:20 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:20 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Temporary image 6dca12c4-e54e-4172-8642-cefd07ec0f99 is fetched for user 70992425e69042498a225f62546c870c. {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 02:05:20 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c9296f-2c85-41f7-b89c-db64de44010e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:20 devstack sudo[87117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD
Feb 27 02:05:20 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:20 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267 1073741824" returned: 0 in 0.861s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:20 devstack sudo[87121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267
Feb 27 02:05:20 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:21 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:21 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "cinder-999b584a-4356-4753-8986-f0852c4713b8-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267" returned: 0 in 0.622s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.206s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1466629748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d0f15b-a98e-457f-ab8c-0d0aff6b7418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6584e3f6a8cb4fb6ab4e58e1c90a369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:18Z,use_quota=True,user_id='70992425e69042498a225f62546c870c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Creating volume 17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:21 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9059959f-2053-4d70-9859-4add4c7790be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9277a1-971a-422c-9304-1124b6e89267', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b18231-847d-458c-89ab-8394a5e279fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:21 devstack sudo[87127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 1073741824
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Lock "cinder-999b584a-4356-4753-8986-f0852c4713b8-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:21 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=133,cinder:SELECT=91,cinder:DELETE=12,cinder:INSERT=32 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:05:21 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Volume volume-7f9277a1-971a-422c-9304-1124b6e89267 (7f9277a1-971a-422c-9304-1124b6e89267): created successfully
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b18231-847d-458c-89ab-8394a5e279fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Flow 'volume_create_manager' (2ea3da2d-f1dc-4022-b881-986b6c3f1718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:21 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1f9c2529-adb4-4e5c-a6cc-9a513e12ff4f tempest-VolumesServicesTestJSON-1295665239 None] Created volume successfully.
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "cinder-quobyte-999b584a-4356-4753-8986-f0852c4713b8" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Lock "cinder-quobyte-999b584a-4356-4753-8986-f0852c4713b8" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecff2cd-12a8-4f19-9d83-3d6140d7a6a4]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:21 devstack sudo[87135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8
Feb 27 02:05:21 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Acquiring lock "cinder-7f9277a1-971a-422c-9304-1124b6e89267-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Lock "cinder-7f9277a1-971a-422c-9304-1124b6e89267-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Acquiring lock "cinder-quobyte-7f9277a1-971a-422c-9304-1124b6e89267" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Lock "cinder-quobyte-7f9277a1-971a-422c-9304-1124b6e89267" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76d303-ab32-4145-8624-d03547846b9e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:22 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8" returned: 0 in 0.748s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:22 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267
Feb 27 02:05:22 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:22 devstack sudo[87161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8
Feb 27 02:05:22 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:22 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 1073741824" returned: 0 in 0.948s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:22 devstack sudo[87164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418
Feb 27 02:05:22 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:22 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267" returned: 0 in 0.523s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:22 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-999b584a-4356-4753-8986-f0852c4713b8" returned: 0 in 0.464s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:22 devstack sudo[87171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267
Feb 27 02:05:22 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Lock "cinder-quobyte-999b584a-4356-4753-8986-f0852c4713b8" released by "delete_volume" :: held 1.252s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Created reservations ['22130874-9591-42bb-9829-db1b186cfb83', '944b89c5-a654-422c-bbd0-fff217e8bb53', '626ae511-e7b4-4ab6-82e2-847d9dbac5e0', '2ee371ed-7b9f-4673-b6a0-9d2ea0e38a8c'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:05:22 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" returned: 0 in 0.482s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Attempting download of 6dca12c4-e54e-4172-8642-cefd07ec0f99 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}])) to volume 17d0f15b-a98e-457f-ab8c-0d0aff6b7418. {{(pid=83140) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:22 devstack sudo[87174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0716523-bced-493b-85d0-2a77f2568553]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_d2lwlobl {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:22 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:22 devstack sudo[87175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_d2lwlobl
Feb 27 02:05:22 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:23 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f9277a1-971a-422c-9304-1124b6e89267" returned: 0 in 0.654s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Lock "cinder-quobyte-7f9277a1-971a-422c-9304-1124b6e89267" released by "delete_volume" :: held 1.209s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Created reservations ['21323039-8a2c-41de-ab36-193c873082d6', 'a62c6be0-b2e8-4f02-822e-5e9de2a8a990', '42554799-02ca-444c-b975-a0c66fd16b1b', 'b5a824e3-6fdc-487d-9122-4257e1b2cd43'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:05:23 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.575s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:05:23 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Deleted volume successfully.
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fe918910-19d4-42e7-b8a9-843f911a1cab tempest-ServersNegativeTestJSON-1746894891 None] Lock "cinder-999b584a-4356-4753-8986-f0852c4713b8-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:23 devstack sudo[87183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:05:23 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:23 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_d2lwlobl" returned: 0 in 0.618s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_d2lwlobl {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "cinder-768a0722-4fec-4ad5-b41c-be8d4cdf4fba-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Lock "cinder-768a0722-4fec-4ad5-b41c-be8d4cdf4fba-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "cinder-quobyte-768a0722-4fec-4ad5-b41c-be8d4cdf4fba" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Lock "cinder-quobyte-768a0722-4fec-4ad5-b41c-be8d4cdf4fba" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:23 devstack sudo[87185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_d2lwlobl
Feb 27 02:05:23 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f61bd5-f8a1-441c-9cd0-02b110de9b34]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:23 devstack sudo[87187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba
Feb 27 02:05:23 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:23 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.434s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:05:23 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Deleted volume successfully.
Feb 27 02:05:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-37d35f8a-dea5-4085-bfa8-0137a43439fa tempest-VolumesServicesTestJSON-1295665239 None] Lock "cinder-7f9277a1-971a-422c-9304-1124b6e89267-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:24 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_d2lwlobl" returned: 1 in 0.494s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_d2lwlobl' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ae097f-40d7-4c40-8b79-3d4994272513]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:24 devstack sudo[87192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD
Feb 27 02:05:24 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:24 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba" returned: 0 in 0.527s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:24 devstack sudo[87197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba
Feb 27 02:05:24 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:24 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] 6dca12c4-e54e-4172-8642-cefd07ec0f99 was qcow2, converting to raw {{(pid=83140) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:24 devstack sudo[87203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418
Feb 27 02:05:24 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:24 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-768a0722-4fec-4ad5-b41c-be8d4cdf4fba" returned: 0 in 0.501s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Lock "cinder-quobyte-768a0722-4fec-4ad5-b41c-be8d4cdf4fba" released by "delete_volume" :: held 1.052s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Created reservations ['731e1a9c-5a3d-479c-b625-cfedca1b6930', 'e9597d54-1e24-4390-82bb-f6a0cdeaf5c7', '2dbe9294-70ed-4083-9540-591ee2b16395', '51266d21-9fdd-4380-a562-d320f0fa1b07'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:24 devstack sudo[87205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:05:24 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:25 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.585s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:25 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:05:25 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Deleted volume successfully.
Feb 27 02:05:25 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8f4ce21c-a444-4bf2-b97e-0a6411e52d3b tempest-ServersNegativeTestJSON-1746894891 None] Lock "cinder-768a0722-4fec-4ad5-b41c-be8d4cdf4fba-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:25 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" returned: 0 in 1.253s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:25 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_4ghitr0gdevstack@QuobyteHD, size 112.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:05:25 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Converted 112.00 MB image at 89.33 MB/s
Feb 27 02:05:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:25 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 1G
Feb 27 02:05:25 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:26 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 1G" returned: 0 in 0.624s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:26 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4c0cd0-ad78-40ba-86c3-30730b30eef8]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:26 devstack sudo[87226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418
Feb 27 02:05:26 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:27 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" returned: 0 in 0.673s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:27 devstack sudo[87238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418
Feb 27 02:05:27 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:28 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" returned: 1 in 0.955s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Downloaded image 6dca12c4-e54e-4172-8642-cefd07ec0f99 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}])) to volume 17d0f15b-a98e-457f-ab8c-0d0aff6b7418 successfully. {{(pid=83140) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Temporary image 6dca12c4-e54e-4172-8642-cefd07ec0f99 for user 70992425e69042498a225f62546c870c is deleted. {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Marking volume 17d0f15b-a98e-457f-ab8c-0d0aff6b7418 as bootable. {{(pid=83140) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=125,cinder:UPDATE=123,cinder:INSERT=43,cinder:DELETE=9 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Copying metadata from image 6dca12c4-e54e-4172-8642-cefd07ec0f99 to 17d0f15b-a98e-457f-ab8c-0d0aff6b7418. {{(pid=83140) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Creating volume glance metadata for volume 17d0f15b-a98e-457f-ab8c-0d0aff6b7418 backed by image 6dca12c4-e54e-4172-8642-cefd07ec0f99 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83140) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e538ed0-1ab5-42fc-97fd-a68f9cd103ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7587a61060>}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72691537-d2c6-46c6-94b5-56960b9131ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:28 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Volume volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 (17d0f15b-a98e-457f-ab8c-0d0aff6b7418): created successfully
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72691537-d2c6-46c6-94b5-56960b9131ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Flow 'volume_create_manager' (ee5a3e5e-5356-4e06-939e-3ca6a5a402f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:28 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-537b13a2-0d44-459e-baf6-8af5679dc869 tempest-VolumesExtendTest-807140184 None] Created volume successfully.
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5bbf8e-9ba6-40c2-8f90-fadbc6977fdc]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:28 devstack sudo[87261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36
Feb 27 02:05:28 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:29 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36" returned: 0 in 0.865s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c4838d-d139-4cf9-a28b-8a16757f9ab3]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Flow 'volume_create_manager' (9e8e01aa-89ab-4179-b3c3-a10d7c3dd14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:29 devstack sudo[87268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36
Feb 27 02:05:29 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fae51d-4be7-4a13-b09f-14b927bdd3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fae51d-4be7-4a13-b09f-14b927bdd3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-910791520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe805b02-9cb4-463e-918f-0b42c7554bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e72caad81eb4e9ea34498f0ab9bd65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:29Z,use_quota=True,user_id='90920e924a614d9288e71787f71d3c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3cd691f-2967-4620-b723-8b637d7da20f),volume_type_id=f3cd691f-2967-4620-b723-8b637d7da20f)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b42188-fbd5-4904-bd89-0373e48db639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b42188-fbd5-4904-bd89-0373e48db639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb923eb-db46-4219-b724-2a6209ebb767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb923eb-db46-4219-b724-2a6209ebb767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe805b02-9cb4-463e-918f-0b42c7554bc7', 'volume_name': 'volume-fe805b02-9cb4-463e-918f-0b42c7554bc7', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef3d8c-ae69-43c4-bf7c-fe909d8de380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef3d8c-ae69-43c4-bf7c-fe909d8de380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84a1c91-59cc-4c80-8a82-c84e50e0b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:29 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Volume fe805b02-9cb4-463e-918f-0b42c7554bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe805b02-9cb4-463e-918f-0b42c7554bc7', 'volume_size': 1}
Feb 27 02:05:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:30 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36" returned: 0 in 0.616s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.fd84593a-d5b8-4699-82e5-76f402b59d67kdwu5dja.img {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:30 devstack sudo[87274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.fd84593a-d5b8-4699-82e5-76f402b59d67kdwu5dja.img
Feb 27 02:05:30 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:32 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.fd84593a-d5b8-4699-82e5-76f402b59d67kdwu5dja.img" returned: 0 in 2.230s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e002b303-1bbe-4bed-b0d5-025eba20f641]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:32 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36
Feb 27 02:05:32 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:32 devstack sudo[87288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:05:32 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:32 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36" returned: 0 in 0.692s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.fd84593a-d5b8-4699-82e5-76f402b59d67kdwu5dja.img {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:05:32 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Converted 1024.00 MB image at 458.83 MB/s
Feb 27 02:05:32 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] fd84593a-d5b8-4699-82e5-76f402b59d67 was raw, no need to convert to raw {{(pid=83140) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Feb 27 02:05:33 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.477s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Flow 'volume_create_manager' (d176dae7-3f6f-4a5e-ae5b-19b616e8be20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3008cfc5-178d-4164-b564-a74414acd333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3008cfc5-178d-4164-b564-a74414acd333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1565084696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c906045-c38a-42ab-b6a8-f4bbc4a0aab9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8842f12f25864f58a4152ed37be031eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:41Z,use_quota=True,user_id='503c890f453343f3aa15d3b9486e89ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e664140-0342-4e45-9926-8e4159126921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e664140-0342-4e45-9926-8e4159126921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9503f4c7-29f1-4c73-9dd4-07d6064156e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9503f4c7-29f1-4c73-9dd4-07d6064156e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c906045-c38a-42ab-b6a8-f4bbc4a0aab9', 'volume_name': 'volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba9bbbe-6bc3-4e77-a80f-45d8b9e95584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba9bbbe-6bc3-4e77-a80f-45d8b9e95584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9564b12-bb80-4652-8cf1-5acf8c6c7e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:41 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Volume 6c906045-c38a-42ab-b6a8-f4bbc4a0aab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9', 'volume_size': 1}
Feb 27 02:05:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.733s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Uploaded volume to glance image-id: fd84593a-d5b8-4699-82e5-76f402b59d67. {{(pid=83140) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 27 02:05:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 14.805s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:44 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-aafe08e2-25f1-49f5-8efe-6c1f62c97e8b tempest-VolumesActionsTest-1083006709 None] Copy volume to image completed successfully.
Feb 27 02:05:44 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fccd22-1365-4940-973a-1a558100090b]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:44 devstack sudo[87338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418
Feb 27 02:05:44 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:44 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" returned: 0 in 0.521s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:44 devstack sudo[87342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418
Feb 27 02:05:44 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:45 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" returned: 1 in 0.655s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 2G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 2G" returned: 0 in 0.051s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.282s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.920s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-910791520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe805b02-9cb4-463e-918f-0b42c7554bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e72caad81eb4e9ea34498f0ab9bd65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:29Z,use_quota=True,user_id='90920e924a614d9288e71787f71d3c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3cd691f-2967-4620-b723-8b637d7da20f),volume_type_id=f3cd691f-2967-4620-b723-8b637d7da20f)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Creating volume fe805b02-9cb4-463e-918f-0b42c7554bc7 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:45 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:45 devstack sudo[87350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7 1073741824
Feb 27 02:05:45 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:45 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6a63aa0c-935c-455d-a363-24d37eb09d04 tempest-VolumesExtendTest-807140184 None] Extend volume completed successfully.
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Acquiring lock "cinder-17d0f15b-a98e-457f-ab8c-0d0aff6b7418-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Lock "cinder-17d0f15b-a98e-457f-ab8c-0d0aff6b7418-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Acquiring lock "cinder-quobyte-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Lock "cinder-quobyte-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ee76f4-c8e1-477b-a45e-80d435a1c339]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:46 devstack sudo[87352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418
Feb 27 02:05:46 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:46 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7 1073741824" returned: 0 in 0.663s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:46 devstack sudo[87357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7
Feb 27 02:05:46 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:46 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" returned: 0 in 0.556s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:46 devstack sudo[87361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418
Feb 27 02:05:46 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:46 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7" returned: 0 in 0.479s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.278s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1565084696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c906045-c38a-42ab-b6a8-f4bbc4a0aab9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8842f12f25864f58a4152ed37be031eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:41Z,use_quota=True,user_id='503c890f453343f3aa15d3b9486e89ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Creating volume 6c906045-c38a-42ab-b6a8-f4bbc4a0aab9 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:46 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84a1c91-59cc-4c80-8a82-c84e50e0b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe805b02-9cb4-463e-918f-0b42c7554bc7', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:46 devstack sudo[87364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9 1073741824
Feb 27 02:05:46 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33969fb-6edf-4f98-898e-11758c3b717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:46 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Volume volume-fe805b02-9cb4-463e-918f-0b42c7554bc7 (fe805b02-9cb4-463e-918f-0b42c7554bc7): created successfully
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33969fb-6edf-4f98-898e-11758c3b717f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Flow 'volume_create_manager' (9e8e01aa-89ab-4179-b3c3-a10d7c3dd14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:46 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-67a1d22e-0093-434d-a1a3-4ec975165e23 tempest-VolumeTypesAccessTest-158547362 None] Created volume successfully.
Feb 27 02:05:47 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" returned: 1 in 0.511s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:47 devstack sudo[87369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418
Feb 27 02:05:47 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:47 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9 1073741824" returned: 0 in 0.550s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:47 devstack sudo[87374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9
Feb 27 02:05:47 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:47 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" returned: 0 in 0.432s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Lock "cinder-quobyte-17d0f15b-a98e-457f-ab8c-0d0aff6b7418" released by "delete_volume" :: held 1.545s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Created reservations ['13490d2e-2e5a-4f31-95a3-72da08db17b1', '8db635d6-8f25-4e55-a2ce-bdb7b1abf707', 'f5d302b4-deb3-4039-9543-3f98ff9df79a', 'de407be9-175a-4ba6-8c22-223ce0fd1502'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:47 devstack sudo[87378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:05:47 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:47 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9" returned: 0 in 0.495s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.116s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9564b12-bb80-4652-8cf1-5acf8c6c7e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58018882-cd3c-4fa2-88d7-9f473ca106fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfced64-f45e-457b-b4fd-f2289321e3cb]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:47 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Volume volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9 (6c906045-c38a-42ab-b6a8-f4bbc4a0aab9): created successfully
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58018882-cd3c-4fa2-88d7-9f473ca106fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Flow 'volume_create_manager' (d176dae7-3f6f-4a5e-ae5b-19b616e8be20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Acquiring lock "cinder-fe805b02-9cb4-463e-918f-0b42c7554bc7-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Lock "cinder-fe805b02-9cb4-463e-918f-0b42c7554bc7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b89fecf8-6b8b-4e0d-8d06-5eb678a706c3 tempest-VolumesTestJSON-1794155135 None] Created volume successfully.
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Acquiring lock "cinder-quobyte-fe805b02-9cb4-463e-918f-0b42c7554bc7" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Lock "cinder-quobyte-fe805b02-9cb4-463e-918f-0b42c7554bc7" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5563fe03-ccb5-4561-8846-f25839fe0b46]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:47 devstack sudo[87381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36
Feb 27 02:05:47 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:48 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7
Feb 27 02:05:48 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:48 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.502s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:05:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Deleted volume successfully.
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1a26d4c8-5fe0-4989-b3b6-ac4b429d1b29 tempest-VolumesExtendTest-807140184 None] Lock "cinder-17d0f15b-a98e-457f-ab8c-0d0aff6b7418-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Flow 'volume_create_manager' (e8599005-4586-4d88-9efe-c47e695dcd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b499ceb6-76d6-434c-a528-8eaac462076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b499ceb6-76d6-434c-a528-8eaac462076c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2140545920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb3db67-21c6-4357-a44f-e1727d42a0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6584e3f6a8cb4fb6ab4e58e1c90a369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:48Z,use_quota=True,user_id='70992425e69042498a225f62546c870c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d79176-0bad-4c6f-a37f-3bccfb9b1952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d79176-0bad-4c6f-a37f-3bccfb9b1952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804f2297-549f-4c51-bccb-0b4e8cf8d391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804f2297-549f-4c51-bccb-0b4e8cf8d391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb3db67-21c6-4357-a44f-e1727d42a0c6', 'volume_name': 'volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684278db-2d61-4ef8-bec8-d4ccb4b276b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684278db-2d61-4ef8-bec8-d4ccb4b276b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72647a4b-cc26-4493-9632-f298a891c14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:48 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Volume bcb3db67-21c6-4357-a44f-e1727d42a0c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6', 'volume_size': 1}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:48 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36" returned: 0 in 0.622s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:48 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9367cfbc-c2c6-4327-a0bc-5dcfd30a639e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7" returned: 0 in 0.585s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:48 devstack sudo[87393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7
Feb 27 02:05:48 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:48 devstack sudo[87392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36
Feb 27 02:05:48 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:49 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fe805b02-9cb4-463e-918f-0b42c7554bc7" returned: 0 in 0.603s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:49 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Lock "cinder-quobyte-fe805b02-9cb4-463e-918f-0b42c7554bc7" released by "delete_volume" :: held 1.223s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36" returned: 0 in 0.640s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:49 devstack sudo[87400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img
Feb 27 02:05:49 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Flow 'volume_create_manager' (ee96ec16-5750-41e8-9ae5-3e61f1ce3f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67a1999-9920-4318-ae04-9dfed600114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:49 devstack cinder-volume[83140]: WARNING cinder.quota [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-728095275 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-728095275, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:05:49 devstack cinder-volume[83140]: WARNING cinder.quota [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-728095275 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-728095275, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Created reservations ['f6a68bee-1f1a-468b-b7a4-0a18092c884d', '44e9a366-52a9-453a-af2e-06629c5447cc', 'e3d6eb8d-70ee-47a3-af47-1c8f7615fe1a', '36e12fed-eefb-4c03-9a3b-47c298cc9ae7'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67a1999-9920-4318-ae04-9dfed600114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-97065828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d691e9-3afc-41e1-9a3b-74534084c5f7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8842f12f25864f58a4152ed37be031eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:49Z,use_quota=True,user_id='503c890f453343f3aa15d3b9486e89ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de770a8-5e4c-4931-822c-09532a1115a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de770a8-5e4c-4931-822c-09532a1115a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d930b34-cb7a-424d-81ff-fba7d5edbe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d930b34-cb7a-424d-81ff-fba7d5edbe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d691e9-3afc-41e1-9a3b-74534084c5f7', 'volume_name': 'volume-02d691e9-3afc-41e1-9a3b-74534084c5f7', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9b0893-8696-4c69-a9c4-0a60235b4792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9b0893-8696-4c69-a9c4-0a60235b4792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11caf1c8-d75d-45f8-aadd-ca4171c96eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:49 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Volume 02d691e9-3afc-41e1-9a3b-74534084c5f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d691e9-3afc-41e1-9a3b-74534084c5f7', 'volume_size': 1}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:49 devstack sudo[87402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:05:49 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:50 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.015s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:50 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:05:50 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Deleted volume successfully.
Feb 27 02:05:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b627f2d6-1c75-438f-a01f-e1738d768fc6 tempest-VolumeTypesAccessTest-158547362 None] Lock "cinder-fe805b02-9cb4-463e-918f-0b42c7554bc7-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:51 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img" returned: 0 in 2.254s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:51 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b237b890-a884-4f68-bae6-53d58de2d69b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:51 devstack sudo[87415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36
Feb 27 02:05:51 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:52 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36" returned: 0 in 0.707s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:52 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:05:52 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Converted 1024.00 MB image at 454.20 MB/s
Feb 27 02:05:52 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] 908d0e22-943c-47be-8033-5e519b85ba86 was raw, converting to qcow2 {{(pid=83140) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Feb 27 02:05:52 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df7741-c2ba-478d-8a88-0dc8ef098eac]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:52 devstack sudo[87421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img
Feb 27 02:05:52 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:52 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img" returned: 0 in 0.541s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:52 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img
Feb 27 02:05:52 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:53 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img" returned: 1 in 0.594s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:05:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img /opt/stack/data/cinder/conversion/vol_upload_cftoafuj {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:53 devstack sudo[87431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img /opt/stack/data/cinder/conversion/vol_upload_cftoafuj
Feb 27 02:05:53 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:53 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img /opt/stack/data/cinder/conversion/vol_upload_cftoafuj" returned: 0 in 0.501s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:53 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Image conversion details: src /opt/stack/data/cinder/conversion/9ca61971-2f77-4ab7-a92c-9efee711ff36.temp_image.908d0e22-943c-47be-8033-5e519b85ba8613i38bao.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_cftoafuj {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:05:53 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Converted 1024.00 MB image at 1024.00 MB/s
Feb 27 02:05:53 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee03bae-c10f-4d0b-85b6-05dd372df079]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cftoafuj {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:53 devstack sudo[87436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cftoafuj
Feb 27 02:05:53 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:54 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cftoafuj" returned: 0 in 0.532s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.593s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Uploaded volume to glance image-id: 908d0e22-943c-47be-8033-5e519b85ba86. {{(pid=83140) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.032s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2140545920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb3db67-21c6-4357-a44f-e1727d42a0c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6584e3f6a8cb4fb6ab4e58e1c90a369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:48Z,use_quota=True,user_id='70992425e69042498a225f62546c870c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Creating volume bcb3db67-21c6-4357-a44f-e1727d42a0c6 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:55 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:55 devstack sudo[87441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 1073741824
Feb 27 02:05:55 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-97a09474-9c26-4cb5-afb5-9623c3c3b31a tempest-VolumesActionsTest-1083006709 None] Copy volume to image completed successfully.
Feb 27 02:05:56 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 1073741824" returned: 0 in 0.603s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:56 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6
Feb 27 02:05:56 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Acquiring lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:56 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Acquiring lock "cinder-quobyte-9ca61971-2f77-4ab7-a92c-9efee711ff36" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6" returned: 0 in 0.563s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.282s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-97065828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d691e9-3afc-41e1-9a3b-74534084c5f7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8842f12f25864f58a4152ed37be031eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:49Z,use_quota=True,user_id='503c890f453343f3aa15d3b9486e89ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Creating volume 02d691e9-3afc-41e1-9a3b-74534084c5f7 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:05:56 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72647a4b-cc26-4493-9632-f298a891c14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:56 devstack sudo[87449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7 1073741824
Feb 27 02:05:56 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc2fc38-744e-4df9-987f-8225b23a9e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Lock "cinder-quobyte-9ca61971-2f77-4ab7-a92c-9efee711ff36" acquired by "delete_volume" :: waited 0.054s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:05:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Volume volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 (bcb3db67-21c6-4357-a44f-e1727d42a0c6): created successfully
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc2fc38-744e-4df9-987f-8225b23a9e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Flow 'volume_create_manager' (e8599005-4586-4d88-9efe-c47e695dcd4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6f1b4-214a-4ce9-a5ed-735409911cbc]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:56 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d52d7b5d-65a8-468c-9a5a-1d6b68a3aa0a tempest-VolumesExtendTest-807140184 None] Created volume successfully.
Feb 27 02:05:56 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36
Feb 27 02:05:56 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:57 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7 1073741824" returned: 0 in 0.700s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:57 devstack sudo[87461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7
Feb 27 02:05:57 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:57 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36" returned: 0 in 0.785s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:57 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36
Feb 27 02:05:57 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:57 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7" returned: 0 in 0.595s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:05:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.946s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Creating offline snapshot 37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 of volume bcb3db67-21c6-4357-a44f-e1727d42a0c6 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11caf1c8-d75d-45f8-aadd-ca4171c96eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d691e9-3afc-41e1-9a3b-74534084c5f7', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3708c34d-143e-4bc9-837d-511b22c7136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7862fa-bd23-40b2-ba51-5c42cc5f0f66]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:58 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Volume volume-02d691e9-3afc-41e1-9a3b-74534084c5f7 (02d691e9-3afc-41e1-9a3b-74534084c5f7): created successfully
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3708c34d-143e-4bc9-837d-511b22c7136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Flow 'volume_create_manager' (ee96ec16-5750-41e8-9ae5-3e61f1ce3f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:58 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-790a70f3-6c5b-4971-9ff0-d000e4552e15 tempest-VolumesTestJSON-1794155135 None] Created volume successfully.
Feb 27 02:05:58 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6
Feb 27 02:05:58 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:58 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9ca61971-2f77-4ab7-a92c-9efee711ff36" returned: 0 in 0.660s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Lock "cinder-quobyte-9ca61971-2f77-4ab7-a92c-9efee711ff36" released by "delete_volume" :: held 1.486s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Created reservations ['6733c6f0-f950-4890-9266-732feb60b88f', '71e28833-06ca-4943-8c5e-d328b0128929', '47b4e08d-b794-40be-8d15-5ad62cde36d8', '2eb2a6ca-9854-4f5d-a6d2-ad60514f0cc3'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:58 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:05:58 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:58 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6" returned: 0 in 0.579s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:58 devstack sudo[87474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 1G
Feb 27 02:05:58 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:58 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.510s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:05:58 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Deleted volume successfully.
Feb 27 02:05:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-56b093e9-e24a-411a-aef5-f814dd1ad9c6 tempest-VolumesActionsTest-1083006709 None] Lock "cinder-9ca61971-2f77-4ab7-a92c-9efee711ff36-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:05:59 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 1G" returned: 0 in 0.735s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:05:59 devstack sudo[87480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1
Feb 27 02:05:59 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Flow 'volume_create_manager' (6e71ea18-3dc5-4bb9-80ef-6a2337d0b9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddab8e5-c8d4-4f09-87b9-46e59ec482c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddab8e5-c8d4-4f09-87b9-46e59ec482c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1937135222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40f8833-89b1-45cf-9ffa-33e5a6155424,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8842f12f25864f58a4152ed37be031eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:59Z,use_quota=True,user_id='503c890f453343f3aa15d3b9486e89ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1357af6c-3ef7-481e-8dea-9a08b494a140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1357af6c-3ef7-481e-8dea-9a08b494a140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15cfb2c5-658e-4259-86bf-abdb6b852b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15cfb2c5-658e-4259-86bf-abdb6b852b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40f8833-89b1-45cf-9ffa-33e5a6155424', 'volume_name': 'volume-b40f8833-89b1-45cf-9ffa-33e5a6155424', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a70a48c-18d3-42f1-9ecf-46f9beb6f8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a70a48c-18d3-42f1-9ecf-46f9beb6f8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3a125c-3aff-46f1-afd7-4c798b4052f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:05:59 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Volume b40f8833-89b1-45cf-9ffa-33e5a6155424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40f8833-89b1-45cf-9ffa-33e5a6155424', 'volume_size': 1}
Feb 27 02:05:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:00 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1" returned: 0 in 0.684s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:00 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 is being set with open permissions: ugo+rw
Feb 27 02:06:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:00 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1
Feb 27 02:06:00 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:00 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1" returned: 0 in 0.531s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:00 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.info
Feb 27 02:06:00 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:01 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.info" returned: 0 in 0.570s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:01 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.info is being set with open permissions: ugo+rw
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:01 devstack sudo[87494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.info
Feb 27 02:06:01 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:01 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.info" returned: 0 in 0.598s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.798s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.108s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1937135222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40f8833-89b1-45cf-9ffa-33e5a6155424,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8842f12f25864f58a4152ed37be031eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:59Z,use_quota=True,user_id='503c890f453343f3aa15d3b9486e89ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Creating volume b40f8833-89b1-45cf-9ffa-33e5a6155424 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:01 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:01 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424 1073741824
Feb 27 02:06:01 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:01 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-900105a7-48c2-463b-b8c8-652d531f7ef7 tempest-VolumesExtendTest-807140184 None] Create snapshot completed successfully
Feb 27 02:06:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4dabf746-a6ce-4421-9a8e-44481b6dab2c tempest-VolumesExtendTest-807140184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:02 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424 1073741824" returned: 0 in 0.805s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:02 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424
Feb 27 02:06:02 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:03 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424" returned: 0 in 0.608s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4dabf746-a6ce-4421-9a8e-44481b6dab2c tempest-VolumesExtendTest-807140184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.910s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3a125c-3aff-46f1-afd7-4c798b4052f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40f8833-89b1-45cf-9ffa-33e5a6155424', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5704aa-03cf-4848-a43a-4f5a0faa5d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1fdeca-267a-4b44-b197-959b5a1793dd]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4dabf746-a6ce-4421-9a8e-44481b6dab2c tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:03 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Volume volume-b40f8833-89b1-45cf-9ffa-33e5a6155424 (b40f8833-89b1-45cf-9ffa-33e5a6155424): created successfully
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5704aa-03cf-4848-a43a-4f5a0faa5d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Flow 'volume_create_manager' (6e71ea18-3dc5-4bb9-80ef-6a2337d0b9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:03 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bc72b2c7-62d4-4ec5-9c9f-e4da4ebcf77a tempest-VolumesTestJSON-1794155135 None] Created volume successfully.
Feb 27 02:06:03 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6
Feb 27 02:06:03 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:04 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4dabf746-a6ce-4421-9a8e-44481b6dab2c tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6" returned: 0 in 0.711s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4dabf746-a6ce-4421-9a8e-44481b6dab2c tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 2G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4dabf746-a6ce-4421-9a8e-44481b6dab2c tempest-VolumesExtendTest-807140184 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 2G" returned: 0 in 0.138s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4dabf746-a6ce-4421-9a8e-44481b6dab2c tempest-VolumesExtendTest-807140184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.905s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:04 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4dabf746-a6ce-4421-9a8e-44481b6dab2c tempest-VolumesExtendTest-807140184 None] Extend volume completed successfully.
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "cinder-b40f8833-89b1-45cf-9ffa-33e5a6155424-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-b40f8833-89b1-45cf-9ffa-33e5a6155424-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "cinder-quobyte-b40f8833-89b1-45cf-9ffa-33e5a6155424" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-quobyte-b40f8833-89b1-45cf-9ffa-33e5a6155424" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e139013d-ea3d-4115-b4c4-2edebffde094]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Acquiring lock "cinder-37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Lock "cinder-37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Acquiring lock "cinder-quobyte-bcb3db67-21c6-4357-a44f-e1727d42a0c6" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:04 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424
Feb 27 02:06:04 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Lock "cinder-quobyte-bcb3db67-21c6-4357-a44f-e1727d42a0c6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Acquiring lock "cinder-quobyte-37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Lock "cinder-quobyte-37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Deleting offline snapshot 37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 of volume bcb3db67-21c6-4357-a44f-e1727d42a0c6 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] snapshot_file for this snap is: volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b0a1cc-e185-47b8-94a4-5146eeec0d91]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:04 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1
Feb 27 02:06:04 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:05 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424" returned: 0 in 0.751s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:05 devstack sudo[87525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424
Feb 27 02:06:05 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:05 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1" returned: 0 in 0.674s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e644b2fc-3766-4132-8a02-067690d24ac2]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:05 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6
Feb 27 02:06:05 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Flow 'volume_create_manager' (6cc7be16-a49a-4095-abba-db37475895f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7642da-9267-4e28-99ed-f16b38149baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7642da-9267-4e28-99ed-f16b38149baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1362151216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c799de9-3c7c-437b-94e9-ffb9f76f9814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6966a354ad7348e78370a00cf02fde40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:06Z,use_quota=True,user_id='a15c7e4e0809402db2764b491de2e9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c14040f-a690-41fe-a8fa-2ba21dc54af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c14040f-a690-41fe-a8fa-2ba21dc54af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5684ce-2a85-40f2-a38c-0c2de93daeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5684ce-2a85-40f2-a38c-0c2de93daeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c799de9-3c7c-437b-94e9-ffb9f76f9814', 'volume_name': 'volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5aaabb4-5ed3-4f1f-8b87-f1352d4f05eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5aaabb4-5ed3-4f1f-8b87-f1352d4f05eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e40235-7cef-4a2a-9e81-ceaeca4e5216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:05 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Volume 0c799de9-3c7c-437b-94e9-ffb9f76f9814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814', 'volume_size': 1}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1362151216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c799de9-3c7c-437b-94e9-ffb9f76f9814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6966a354ad7348e78370a00cf02fde40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:06Z,use_quota=True,user_id='a15c7e4e0809402db2764b491de2e9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Creating volume 0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:05 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:05 devstack sudo[87530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 1073741824
Feb 27 02:06:05 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:05 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b40f8833-89b1-45cf-9ffa-33e5a6155424" returned: 0 in 0.559s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-quobyte-b40f8833-89b1-45cf-9ffa-33e5a6155424" released by "delete_volume" :: held 1.342s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Created reservations ['18d61cbb-4b36-42a0-9af8-1fd6e2e2898c', '8e20eae8-1082-4b51-bda9-63e5d1245f95', '69dbcef2-82ca-417b-8a73-932ecfae5406', '4ef42367-cadf-4fb7-b4aa-7e4b24f13b52'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:06 devstack sudo[87532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:06 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:06 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6" returned: 0 in 0.865s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:06 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1
Feb 27 02:06:06 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:06 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 1073741824" returned: 0 in 0.721s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:06 devstack sudo[87543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814
Feb 27 02:06:06 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:06 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.603s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:06 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Deleted volume successfully.
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-818d301c-22ae-44d3-9d23-f8ed9dd8cbf8 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-b40f8833-89b1-45cf-9ffa-33e5a6155424-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "cinder-02d691e9-3afc-41e1-9a3b-74534084c5f7-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-02d691e9-3afc-41e1-9a3b-74534084c5f7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "cinder-quobyte-02d691e9-3afc-41e1-9a3b-74534084c5f7" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-quobyte-02d691e9-3afc-41e1-9a3b-74534084c5f7" acquired by "delete_volume" :: waited 0.024s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[af218059-3b94-4ab2-9a08-934befe681ab]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:06 devstack sudo[87545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7
Feb 27 02:06:06 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:07 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1" returned: 0 in 0.709s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:07 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1
Feb 27 02:06:07 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:07 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814" returned: 0 in 0.634s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e40235-7cef-4a2a-9e81-ceaeca4e5216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b20609-712a-49f5-ae2f-16ac03baebb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:07 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Volume volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 (0c799de9-3c7c-437b-94e9-ffb9f76f9814): created successfully
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b20609-712a-49f5-ae2f-16ac03baebb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Flow 'volume_create_manager' (6cc7be16-a49a-4095-abba-db37475895f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-eb64719c-88d6-4608-9111-8f783238794b tempest-VolumesCloneTest-63583159 None] Created volume successfully.
Feb 27 02:06:07 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7" returned: 0 in 0.661s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:07 devstack sudo[87557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7
Feb 27 02:06:07 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:07 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6.37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1" returned: 0 in 0.518s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Lock "cinder-quobyte-37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1" released by "_delete_snapshot" :: held 2.835s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Lock "cinder-quobyte-bcb3db67-21c6-4357-a44f-e1727d42a0c6" released by "delete_snapshot" :: held 2.869s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Created reservations ['cc539989-79a2-4add-a457-a92f07aab417', '42b02c04-1b1b-4767-b072-2991446886cf', '0bb79347-a2d3-44fb-a0ed-d8c8d616b96a', 'accdbbcd-5959-4d7a-a544-30af53b9b773'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Delete snapshot completed successfully.
Feb 27 02:06:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-75ea9668-c410-44ea-865b-0566bca8f6a4 tempest-VolumesExtendTest-807140184 None] Lock "cinder-37c9cef4-a3e4-4b5f-b90e-cb55b4aaaeb1-delete_snapshot" released by "delete_snapshot" :: held 2.978s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Acquiring lock "cinder-bcb3db67-21c6-4357-a44f-e1727d42a0c6-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Lock "cinder-bcb3db67-21c6-4357-a44f-e1727d42a0c6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:08 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Acquiring lock "cinder-quobyte-bcb3db67-21c6-4357-a44f-e1727d42a0c6" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-02d691e9-3afc-41e1-9a3b-74534084c5f7" returned: 0 in 0.567s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-quobyte-02d691e9-3afc-41e1-9a3b-74534084c5f7" released by "delete_volume" :: held 1.253s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Lock "cinder-quobyte-bcb3db67-21c6-4357-a44f-e1727d42a0c6" acquired by "delete_volume" :: waited 0.022s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6a7ed-f3d1-48de-b28d-d6430cd45eb0]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Created reservations ['d07caf86-7a41-48e3-9746-90415f867330', 'e00f6796-9c20-483e-bde3-c0a5ffcbd21b', '11b3eb05-8c14-41c4-bf13-f4ad7424d1ea', '1b261487-19ef-4eb4-81d3-bcd5c136c5bd'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:08 devstack sudo[87560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6
Feb 27 02:06:08 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Flow 'volume_create_manager' (4ac5b6f9-8778-4308-a3e8-8bc7cfeddb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031be634-d4cf-4f36-9eba-393e74e8c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031be634-d4cf-4f36-9eba-393e74e8c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1849468224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fead03a7-a68e-430e-b7ca-aefd80611f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6966a354ad7348e78370a00cf02fde40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=0c799de9-3c7c-437b-94e9-ffb9f76f9814,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:08Z,use_quota=True,user_id='a15c7e4e0809402db2764b491de2e9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c396d41-b01e-4f21-832a-2ffc2245adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c396d41-b01e-4f21-832a-2ffc2245adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb16dc7-3aaa-4457-aee2-4107cfe10ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb16dc7-3aaa-4457-aee2-4107cfe10ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fead03a7-a68e-430e-b7ca-aefd80611f60', 'volume_name': 'volume-fead03a7-a68e-430e-b7ca-aefd80611f60', 'volume_size': 2, 'source_volid': '0c799de9-3c7c-437b-94e9-ffb9f76f9814', 'source_volstatus': 'available'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07d3d1a-0b38-4fc5-a284-ece0ad95d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07d3d1a-0b38-4fc5-a284-ece0ad95d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62276b2-e4fd-4e45-a6ec-68ea8419de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:08 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Volume fead03a7-a68e-430e-b7ca-aefd80611f60: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fead03a7-a68e-430e-b7ca-aefd80611f60', 'volume_size': 2, 'source_volid': '0c799de9-3c7c-437b-94e9-ffb9f76f9814', 'source_volstatus': 'available'}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:08 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Cloning volume 0c799de9-3c7c-437b-94e9-ffb9f76f9814 to volume fead03a7-a68e-430e-b7ca-aefd80611f60
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Creating offline snapshot 0e6945bd-2e19-4467-9ebf-81cf9ad8828e of volume 0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:06:08 devstack sudo[87562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:08 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d34a560-986a-42a1-825a-0190280aa3b6]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:08 devstack sudo[87564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814
Feb 27 02:06:08 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:08 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6" returned: 0 in 0.599s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:08 devstack sudo[87569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6
Feb 27 02:06:08 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:08 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.599s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:08 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Deleted volume successfully.
Feb 27 02:06:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1c086a55-e948-476c-bffe-a7c40f3bcad4 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-02d691e9-3afc-41e1-9a3b-74534084c5f7-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "cinder-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "cinder-quobyte-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-quobyte-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ce244a-bc49-47c8-bf5b-5d18c114e661]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:09 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814" returned: 0 in 0.761s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:09 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e 1G
Feb 27 02:06:09 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:09 devstack sudo[87575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9
Feb 27 02:06:09 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:09 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-bcb3db67-21c6-4357-a44f-e1727d42a0c6" returned: 0 in 0.593s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Lock "cinder-quobyte-bcb3db67-21c6-4357-a44f-e1727d42a0c6" released by "delete_volume" :: held 1.249s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Created reservations ['455d758a-cc90-482a-957d-f1a52816a4c2', 'b282954f-abdb-4ca0-8988-b71692dc7751', '38b7fc7b-252a-49c5-9703-5b349ec537bb', '5b72d6ad-5be0-4010-93a1-a9b6cd87960f'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:09 devstack sudo[87580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:09 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:09 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9" returned: 0 in 0.666s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:09 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e 1G" returned: 0 in 0.653s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:09 devstack sudo[87588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9
Feb 27 02:06:09 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:09 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e
Feb 27 02:06:09 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:09 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.506s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:09 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Deleted volume successfully.
Feb 27 02:06:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-081e386a-5351-49db-8b23-7c7499cc9dd1 tempest-VolumesExtendTest-807140184 None] Lock "cinder-bcb3db67-21c6-4357-a44f-e1727d42a0c6-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:10 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9" returned: 0 in 0.538s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-quobyte-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9" released by "delete_volume" :: held 1.236s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Created reservations ['d8d369af-f562-434f-a344-41bdffba6466', 'ac76cbb8-4583-4ed3-bdf9-0830416b94de', 'e1d062e0-d132-4dd0-86e4-1690302a7e3f', '103d9e9c-a259-47ef-8f6c-eedc90d08a4d'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:10 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e" returned: 0 in 0.624s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:10 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e is being set with open permissions: ugo+rw
Feb 27 02:06:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:10 devstack sudo[87597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:10 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:10 devstack sudo[87598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e
Feb 27 02:06:10 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:11 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e" returned: 0 in 0.580s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:11 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.635s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:11 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:11 devstack sudo[87603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.info
Feb 27 02:06:11 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:11 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Deleted volume successfully.
Feb 27 02:06:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7579f1a9-ab8f-4024-9fcb-e2af6142eef1 tempest-VolumesTestJSON-1794155135 None] Lock "cinder-6c906045-c38a-42ab-b6a8-f4bbc4a0aab9-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:11 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.info" returned: 0 in 0.645s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:11 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.info is being set with open permissions: ugo+rw
Feb 27 02:06:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:11 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.info
Feb 27 02:06:11 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:12 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.info" returned: 0 in 0.571s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Acquiring lock "cinder-quobyte-fead03a7-a68e-430e-b7ca-aefd80611f60" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Lock "cinder-quobyte-fead03a7-a68e-430e-b7ca-aefd80611f60" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] snapshot: 0e6945bd-2e19-4467-9ebf-81cf9ad8828e, volume: fead03a7-a68e-430e-b7ca-aefd80611f60,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a17ebdf-648e-42ce-a821-3264f618ccc7]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:12 devstack sudo[87609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e
Feb 27 02:06:12 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Flow 'volume_create_manager' (c373a16d-08de-47e5-ab62-5d2eebca76d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008ed87e-c78f-4445-aabd-7cecf032dc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008ed87e-c78f-4445-aabd-7cecf032dc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-424439941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f281757d-2d4e-42a5-9b62-2096c943d7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e89286d21d448c9a4a4037a514acdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:13Z,use_quota=True,user_id='1c45a06e34fe4a65946964f45707ff43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ca8b40-9a04-462b-be62-a8e2024e4392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ca8b40-9a04-462b-be62-a8e2024e4392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7ab7fe-f031-4f5f-94af-ba03d5631c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7ab7fe-f031-4f5f-94af-ba03d5631c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f281757d-2d4e-42a5-9b62-2096c943d7b3', 'volume_name': 'volume-f281757d-2d4e-42a5-9b62-2096c943d7b3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c7b6d8-a1ec-42f6-a77a-1e8cb06c4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c7b6d8-a1ec-42f6-a77a-1e8cb06c4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d172528e-ff52-4410-9cc3-196f503f61a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:12 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Volume f281757d-2d4e-42a5-9b62-2096c943d7b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f281757d-2d4e-42a5-9b62-2096c943d7b3', 'volume_size': 1}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:12 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e" returned: 0 in 0.611s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c7bf3f-a7cd-4b7e-9d57-6dbec785dd49]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:13 devstack sudo[87615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814
Feb 27 02:06:13 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:13 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814" returned: 0 in 0.622s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:13 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:06:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:13 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60
Feb 27 02:06:13 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:15 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-28ce5491-2613-46a4-a02f-a79ecc5eebac tempest-GroupSnapshotsTest-76967834 None] Group tempest-GroupSnapshotsTest-Group-1600080478: creating
Feb 27 02:06:15 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-28ce5491-2613-46a4-a02f-a79ecc5eebac tempest-GroupSnapshotsTest-76967834 None] Group tempest-GroupSnapshotsTest-Group-1600080478: created successfully
Feb 27 02:06:15 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-28ce5491-2613-46a4-a02f-a79ecc5eebac tempest-GroupSnapshotsTest-76967834 None] Create group completed successfully.
Feb 27 02:06:16 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60" returned: 0 in 2.648s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dc79e5-56fd-4d27-a516-2bb0a44cd9e6]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:16 devstack sudo[87633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814
Feb 27 02:06:16 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Flow 'volume_create_manager' (60cdf0cf-98a5-47ff-b880-62762bf5aa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba5e1f7-4d35-4ba6-914c-345c6ad2edf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba5e1f7-4d35-4ba6-914c-345c6ad2edf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-684498334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3a7fabb8-9dc9-452f-acd8-845919cbe398,host='devstack@QuobyteHD#QuobyteHD',id=be141167-b7fd-48b3-bbd9-5b4366da109e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9425def193be4b788fb7fcee43d02a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:17Z,use_quota=True,user_id='99af59ded704483181a4ee37662ebe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad8e2f6-fbee-49a3-98a6-ca4fe623e1ee),volume_type_id=fad8e2f6-fbee-49a3-98a6-ca4fe623e1ee)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e9f716-eebf-4bf8-a50e-6836a548e482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e9f716-eebf-4bf8-a50e-6836a548e482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14303636-d103-41ea-a0ab-d14b90b9c2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14303636-d103-41ea-a0ab-d14b90b9c2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be141167-b7fd-48b3-bbd9-5b4366da109e', 'volume_name': 'volume-be141167-b7fd-48b3-bbd9-5b4366da109e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39400452-abe8-473d-93d9-639b3051c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39400452-abe8-473d-93d9-639b3051c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfbbc93-a51a-49f8-8d95-7b8db11ca3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:16 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Volume be141167-b7fd-48b3-bbd9-5b4366da109e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be141167-b7fd-48b3-bbd9-5b4366da109e', 'volume_size': 1}
Feb 27 02:06:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:16 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814" returned: 0 in 0.799s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814, size 1024.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:06:17 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Converted 1024.00 MB image at 386.57 MB/s
Feb 27 02:06:17 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60 is being set with open permissions: ugo+rw
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:17 devstack sudo[87638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60
Feb 27 02:06:17 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:17 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60" returned: 0 in 0.503s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Lock "cinder-quobyte-fead03a7-a68e-430e-b7ca-aefd80611f60" released by "_copy_volume_from_snapshot" :: held 5.243s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Acquiring lock "cinder-quobyte-0e6945bd-2e19-4467-9ebf-81cf9ad8828e" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Lock "cinder-quobyte-0e6945bd-2e19-4467-9ebf-81cf9ad8828e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Deleting offline snapshot 0e6945bd-2e19-4467-9ebf-81cf9ad8828e of volume 0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] snapshot_file for this snap is: volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56c150a-d37d-4ccc-818b-a7fbc9c08cdb]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:17 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e
Feb 27 02:06:17 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:18 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e" returned: 0 in 0.560s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:18 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:18 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[427d41fb-2533-4d83-b53c-f509c24b6e32]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:18 devstack sudo[87646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814
Feb 27 02:06:18 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:18 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814" returned: 0 in 0.542s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:18 devstack sudo[87651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e
Feb 27 02:06:18 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:19 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e" returned: 0 in 0.561s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:19 devstack sudo[87656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e
Feb 27 02:06:19 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:19 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814.0e6945bd-2e19-4467-9ebf-81cf9ad8828e" returned: 0 in 0.498s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Lock "cinder-quobyte-0e6945bd-2e19-4467-9ebf-81cf9ad8828e" released by "_delete_snapshot" :: held 2.219s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.460s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-424439941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f281757d-2d4e-42a5-9b62-2096c943d7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e89286d21d448c9a4a4037a514acdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:13Z,use_quota=True,user_id='1c45a06e34fe4a65946964f45707ff43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Creating volume f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:19 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62276b2-e4fd-4e45-a6ec-68ea8419de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fead03a7-a68e-430e-b7ca-aefd80611f60', 'volume_size': 2, 'source_volid': '0c799de9-3c7c-437b-94e9-ffb9f76f9814', 'source_volstatus': 'available'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:19 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 1073741824
Feb 27 02:06:19 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e755b30f-0d24-4121-8d59-08232557133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Volume volume-fead03a7-a68e-430e-b7ca-aefd80611f60 (fead03a7-a68e-430e-b7ca-aefd80611f60): created successfully
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e755b30f-0d24-4121-8d59-08232557133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Flow 'volume_create_manager' (4ac5b6f9-8778-4308-a3e8-8bc7cfeddb59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bcef0983-f06a-417c-9625-03ae835425a6 tempest-VolumesCloneTest-63583159 None] Created volume successfully.
Feb 27 02:06:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Acquiring lock "cinder-fead03a7-a68e-430e-b7ca-aefd80611f60-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Lock "cinder-fead03a7-a68e-430e-b7ca-aefd80611f60-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Acquiring lock "cinder-quobyte-fead03a7-a68e-430e-b7ca-aefd80611f60" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Lock "cinder-quobyte-fead03a7-a68e-430e-b7ca-aefd80611f60" acquired by "delete_volume" :: waited 0.017s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:20 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac1168c-3e5f-457f-9ba6-22dfef5ccb58]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:20 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60
Feb 27 02:06:20 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:20 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 1073741824" returned: 0 in 0.693s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:20 devstack sudo[87666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3
Feb 27 02:06:20 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:20 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60" returned: 0 in 0.665s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:21 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60
Feb 27 02:06:21 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:21 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3" returned: 0 in 0.579s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.165s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3a7fabb8-9dc9-452f-acd8-845919cbe398,created_at=2026-02-27T01:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-684498334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3a7fabb8-9dc9-452f-acd8-845919cbe398,host='devstack@QuobyteHD#QuobyteHD',id=be141167-b7fd-48b3-bbd9-5b4366da109e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9425def193be4b788fb7fcee43d02a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:17Z,use_quota=True,user_id='99af59ded704483181a4ee37662ebe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad8e2f6-fbee-49a3-98a6-ca4fe623e1ee),volume_type_id=fad8e2f6-fbee-49a3-98a6-ca4fe623e1ee)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Creating volume be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:21 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d172528e-ff52-4410-9cc3-196f503f61a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f281757d-2d4e-42a5-9b62-2096c943d7b3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:21 devstack sudo[87674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e 1073741824
Feb 27 02:06:21 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948b2ba7-16ec-4c9f-b330-49f5a6fc6695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:21 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Volume volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 (f281757d-2d4e-42a5-9b62-2096c943d7b3): created successfully
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948b2ba7-16ec-4c9f-b330-49f5a6fc6695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Flow 'volume_create_manager' (c373a16d-08de-47e5-ab62-5d2eebca76d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:21 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8d1572e3-2dec-4c0b-98e4-1a4d9bd60479 tempest-VolumesSnapshotListTestJSON-1140024695 None] Created volume successfully.
Feb 27 02:06:21 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-fead03a7-a68e-430e-b7ca-aefd80611f60" returned: 0 in 0.555s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Lock "cinder-quobyte-fead03a7-a68e-430e-b7ca-aefd80611f60" released by "delete_volume" :: held 1.258s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=121,cinder:SELECT=106,cinder:INSERT=39,cinder:DELETE=11 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Created reservations ['8781171e-e3da-4430-9293-194055424c13', '71b7ba18-6a26-4485-81ea-7f8c83a902b1', '3c528caa-ff95-4ca9-a5aa-643e4c1bc67d', 'dd23f9a2-3012-4ff6-97ac-c9b5b9ed8c9c'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:21 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:21 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:21 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e 1073741824" returned: 0 in 0.679s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:21 devstack sudo[87682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e
Feb 27 02:06:21 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:22 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.537s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:22 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Deleted volume successfully.
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e74e178b-6bb0-4a37-9d51-23975f82baf8 tempest-VolumesCloneTest-63583159 None] Lock "cinder-fead03a7-a68e-430e-b7ca-aefd80611f60-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:22 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e" returned: 0 in 0.541s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.646s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfbbc93-a51a-49f8-8d95-7b8db11ca3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be141167-b7fd-48b3-bbd9-5b4366da109e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ab39fd-367d-4059-b008-0546d30a07a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Creating offline snapshot 23de94de-fc39-4629-9fed-87a1326a67ef of volume f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:06:22 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Volume volume-be141167-b7fd-48b3-bbd9-5b4366da109e (be141167-b7fd-48b3-bbd9-5b4366da109e): created successfully
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ab39fd-367d-4059-b008-0546d30a07a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Flow 'volume_create_manager' (60cdf0cf-98a5-47ff-b880-62762bf5aa95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a500e9-3735-4690-b7de-5f47c4d54c63]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:22 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e0fb1732-071a-4d8f-9a59-6183a4232853 tempest-GroupSnapshotsTest-76967834 None] Created volume successfully.
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Acquiring lock "cinder-0c799de9-3c7c-437b-94e9-ffb9f76f9814-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Lock "cinder-0c799de9-3c7c-437b-94e9-ffb9f76f9814-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:22 devstack sudo[87688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3
Feb 27 02:06:22 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Acquiring lock "cinder-quobyte-0c799de9-3c7c-437b-94e9-ffb9f76f9814" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Lock "cinder-quobyte-0c799de9-3c7c-437b-94e9-ffb9f76f9814" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0721e3-ba55-4b1d-80f5-19eb335b9168]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:22 devstack sudo[87690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814
Feb 27 02:06:22 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:22 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3" returned: 0 in 0.566s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:23 devstack sudo[87697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef 1G
Feb 27 02:06:23 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:23 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814" returned: 0 in 0.513s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:23 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814
Feb 27 02:06:23 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:23 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] GroupSnapshot b806467b-bc39-4686-babc-5a5486fc004b: creating.
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Group snapshot b806467b-bc39-4686-babc-5a5486fc004b: creating. {{(pid=83140) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:23 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0c799de9-3c7c-437b-94e9-ffb9f76f9814" returned: 0 in 0.520s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:23 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef 1G" returned: 0 in 0.627s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Lock "cinder-quobyte-0c799de9-3c7c-437b-94e9-ffb9f76f9814" released by "delete_volume" :: held 1.090s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:23 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef
Feb 27 02:06:23 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Created reservations ['ac35b3a2-b165-47bf-98dd-f23536a0892d', '28d545a4-8f52-4851-89d8-b86389d0baf5', 'f460a16f-6890-4786-8b14-588894ef17e6', 'da73fccd-e092-4b37-8813-f2dbc5a8f1a8'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:23 devstack sudo[87709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:23 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:24 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef" returned: 0 in 0.451s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:24 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef is being set with open permissions: ugo+rw
Feb 27 02:06:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:24 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef
Feb 27 02:06:24 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:24 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.423s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:24 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:24 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Deleted volume successfully.
Feb 27 02:06:24 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4166c648-6bc8-47bb-92ff-44bc75904513 tempest-VolumesCloneTest-63583159 None] Lock "cinder-0c799de9-3c7c-437b-94e9-ffb9f76f9814-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:24 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef" returned: 0 in 0.397s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:24 devstack sudo[87718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.info
Feb 27 02:06:24 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:24 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.info" returned: 0 in 0.476s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:24 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.info is being set with open permissions: ugo+rw
Feb 27 02:06:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:24 devstack sudo[87721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.info
Feb 27 02:06:24 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:25 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.info" returned: 0 in 0.561s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.169s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.988s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:25 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-86ba8ed0-a4c8-4aac-adc3-2eaecb24b10e tempest-VolumesSnapshotListTestJSON-1140024695 None] Create snapshot completed successfully
Feb 27 02:06:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Creating offline snapshot 405e87f9-d2d6-4551-b31b-d1e09abd151b of volume be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:06:25 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a5c182-37b0-4812-8df9-836e10b8cd07]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:25 devstack sudo[87724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e
Feb 27 02:06:25 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:26 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e" returned: 0 in 0.643s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:26 devstack sudo[87729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b 1G
Feb 27 02:06:26 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:26 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b 1G" returned: 0 in 0.721s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be141167-b7fd-48b3-bbd9-5b4366da109e -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:27 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be141167-b7fd-48b3-bbd9-5b4366da109e -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b
Feb 27 02:06:27 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Flow 'volume_create_manager' (66b86bf9-f55d-478d-b2dc-c42f07a2dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f8efeb-24ab-4991-918a-b550e6c22867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f8efeb-24ab-4991-918a-b550e6c22867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-321099265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50af6d04-4364-4156-961a-0950f2bf0bd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1865ddef51945538f8b9195153120fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:27Z,use_quota=True,user_id='5bef27838c1c4a7d93c87048aa5d20c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43af5f9-046c-4a63-804e-9eea7e2b93b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43af5f9-046c-4a63-804e-9eea7e2b93b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cebd9b-0be9-4495-88bb-cfa8deb4a074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cebd9b-0be9-4495-88bb-cfa8deb4a074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50af6d04-4364-4156-961a-0950f2bf0bd3', 'volume_name': 'volume-50af6d04-4364-4156-961a-0950f2bf0bd3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa94aea-d31d-491b-99d2-fa3014674513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa94aea-d31d-491b-99d2-fa3014674513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2f092b-458a-4ec1-bee3-2ac9c4385311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:27 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Volume 50af6d04-4364-4156-961a-0950f2bf0bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50af6d04-4364-4156-961a-0950f2bf0bd3', 'volume_size': 1}
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:27 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be141167-b7fd-48b3-bbd9-5b4366da109e -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b" returned: 0 in 0.583s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:27 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:06:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:27 devstack sudo[87739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b
Feb 27 02:06:27 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:28 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b" returned: 0 in 0.482s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:28 devstack sudo[87742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.info
Feb 27 02:06:28 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:28 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.info" returned: 0 in 0.435s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:28 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:28 devstack sudo[87746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.info
Feb 27 02:06:28 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:28 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.info" returned: 0 in 0.421s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.380s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.919s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Creating offline snapshot b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c of volume f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=90,cinder:UPDATE=120,cinder:INSERT=30,cinder:DELETE=9 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dcde5a-9383-45a7-87af-a570b6136bc2]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:29 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-27716d9e-a937-404c-a084-fbfcaa2258bf tempest-GroupSnapshotsTest-76967834 None] group_snapshot b806467b-bc39-4686-babc-5a5486fc004b: created successfully
Feb 27 02:06:29 devstack sudo[87764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef
Feb 27 02:06:29 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:29 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef" returned: 0 in 0.606s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f281757d-2d4e-42a5-9b62-2096c943d7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:29 devstack sudo[87770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c 1G
Feb 27 02:06:29 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:30 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c 1G" returned: 0 in 0.547s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:30 devstack sudo[87775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c
Feb 27 02:06:30 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:30 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" returned: 0 in 0.510s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:30 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c is being set with open permissions: ugo+rw
Feb 27 02:06:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:30 devstack sudo[87780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c
Feb 27 02:06:30 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:31 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" returned: 0 in 0.502s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.071s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-321099265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50af6d04-4364-4156-961a-0950f2bf0bd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1865ddef51945538f8b9195153120fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:27Z,use_quota=True,user_id='5bef27838c1c4a7d93c87048aa5d20c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Creating volume 50af6d04-4364-4156-961a-0950f2bf0bd3 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:31 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:31 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3 1073741824
Feb 27 02:06:31 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-065ac08a-d1a0-4397-bc19-8652b2b42e37 tempest-VolumesSnapshotListTestJSON-1140024695 None] Create snapshot completed successfully
Feb 27 02:06:31 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:31 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3 1073741824" returned: 0 in 0.625s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:31 devstack sudo[87791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3
Feb 27 02:06:31 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:32 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3" returned: 0 in 0.475s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.369s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-405e87f9-d2d6-4551-b31b-d1e09abd151b-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" by "_create_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2f092b-458a-4ec1-bee3-2ac9c4385311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50af6d04-4364-4156-961a-0950f2bf0bd3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e80e9e6-f73f-410a-a4bd-d225717ae83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:32 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Volume volume-50af6d04-4364-4156-961a-0950f2bf0bd3 (50af6d04-4364-4156-961a-0950f2bf0bd3): created successfully
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e80e9e6-f73f-410a-a4bd-d225717ae83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Flow 'volume_create_manager' (66b86bf9-f55d-478d-b2dc-c42f07a2dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-405e87f9-d2d6-4551-b31b-d1e09abd151b-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Creating volume 919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc from snapshot 405e87f9-d2d6-4551-b31b-d1e09abd151b {{(pid=83140) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:32 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ad2de1bd-3e75-4608-be8e-d500865750ca tempest-VolumesListTestJSON-1697759733 None] Created volume successfully.
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] snapshot: 405e87f9-d2d6-4551-b31b-d1e09abd151b, volume: 919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c906c-e086-4ead-ad7f-94c13e2d2a97]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:32 devstack sudo[87794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b
Feb 27 02:06:32 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:32 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b" returned: 0 in 0.508s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be141167-b7fd-48b3-bbd9-5b4366da109e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1588692e-aedf-46f3-b572-eb600e308c0a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:33 devstack sudo[87800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e
Feb 27 02:06:33 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:33 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e" returned: 0 in 0.611s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:33 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:06:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:33 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc
Feb 27 02:06:33 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Flow 'volume_create_manager' (d6a4885d-539a-42cb-9778-3735b17982b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0b8784-568e-487e-9a24-f57efea20ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0b8784-568e-487e-9a24-f57efea20ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-404873474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3c9116-1e52-408b-99be-58992b3af053,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1865ddef51945538f8b9195153120fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:34Z,use_quota=True,user_id='5bef27838c1c4a7d93c87048aa5d20c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8956174-bdba-4aa8-b6f9-ac16f65807ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8956174-bdba-4aa8-b6f9-ac16f65807ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f00adf-1e00-40a4-9533-96e8f6a897c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f00adf-1e00-40a4-9533-96e8f6a897c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3c9116-1e52-408b-99be-58992b3af053', 'volume_name': 'volume-1f3c9116-1e52-408b-99be-58992b3af053', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f250488-87f7-484a-b756-c5df79e197dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f250488-87f7-484a-b756-c5df79e197dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83018d3-b5a6-437c-a73c-b6a1cb899ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:34 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Volume 1f3c9116-1e52-408b-99be-58992b3af053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3c9116-1e52-408b-99be-58992b3af053', 'volume_size': 1}
Feb 27 02:06:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:36 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" returned: 0 in 3.182s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f575341a-1b95-4d81-b522-d5839787759a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:36 devstack sudo[87844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e
Feb 27 02:06:36 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (1afb4d21-e058-47c1-b8b8-d3746d1d067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df6bff6-f17a-4053-8d75-e2d55abfd23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df6bff6-f17a-4053-8d75-e2d55abfd23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-492939770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861b80bf-120a-4cad-a217-6b784635d994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:37Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060b9c0f-3dfd-4ebf-a9e7-1b666250151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060b9c0f-3dfd-4ebf-a9e7-1b666250151c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519ef86b-1bdd-41b8-887a-f49e0b3e967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519ef86b-1bdd-41b8-887a-f49e0b3e967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861b80bf-120a-4cad-a217-6b784635d994', 'volume_name': 'volume-861b80bf-120a-4cad-a217-6b784635d994', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b081d93-627c-40d8-8407-a36842cde17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b081d93-627c-40d8-8407-a36842cde17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a99250d-cbbf-40f4-b3d4-ef2fecb7a0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:36 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Volume 861b80bf-120a-4cad-a217-6b784635d994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861b80bf-120a-4cad-a217-6b784635d994', 'volume_size': 1}
Feb 27 02:06:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:37 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e" returned: 0 in 0.671s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:37 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e, size 1024.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:06:37 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Converted 1024.00 MB image at 321.70 MB/s
Feb 27 02:06:37 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:06:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:37 devstack sudo[87849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc
Feb 27 02:06:37 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:37 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" returned: 0 in 0.559s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" released by "_copy_volume_from_snapshot" :: held 5.600s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-405e87f9-d2d6-4551-b31b-d1e09abd151b-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" released by "_create_volume_from_snapshot" :: held 5.630s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.671s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.575s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Creating offline snapshot 17ab47e1-6c68-407e-9efd-fc08cea1c674 of volume f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3cc6d1-a371-4706-bcad-204a47d8295b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:38 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3e6af5f5-df9f-4f56-a147-1829d20d86f7 tempest-GroupSnapshotsTest-76967834 None] Create group from source-snapshot-b806467b-bc39-4686-babc-5a5486fc004b completed successfully.
Feb 27 02:06:38 devstack sudo[87852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c
Feb 27 02:06:38 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:38 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" returned: 0 in 0.569s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f281757d-2d4e-42a5-9b62-2096c943d7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:38 devstack sudo[87857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 1G
Feb 27 02:06:38 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" acquired by "delete_volume" :: waited 0.017s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f20f54-e7b8-4a03-ad33-30120d2667a6]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:39 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc
Feb 27 02:06:39 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:39 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 1G" returned: 0 in 0.664s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:39 devstack sudo[87864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674
Feb 27 02:06:39 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:39 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" returned: 0 in 0.643s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:39 devstack sudo[87906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc
Feb 27 02:06:39 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:39 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674" returned: 0 in 0.602s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:39 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 is being set with open permissions: ugo+rw
Feb 27 02:06:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:39 devstack sudo[87908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674
Feb 27 02:06:39 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:40 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" returned: 0 in 0.527s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-919c55f7-21f2-46d4-b1b9-5cdfeaa7d2bc" released by "delete_volume" :: held 1.200s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:40 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674" returned: 0 in 0.495s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.291s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-404873474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3c9116-1e52-408b-99be-58992b3af053,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1865ddef51945538f8b9195153120fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:34Z,use_quota=True,user_id='5bef27838c1c4a7d93c87048aa5d20c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Creating volume 1f3c9116-1e52-408b-99be-58992b3af053 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:40 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:40 devstack sudo[87912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053 1073741824
Feb 27 02:06:40 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:40 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e5b26c01-d05e-44fc-bb9e-01fad055f691 tempest-VolumesSnapshotListTestJSON-1140024695 None] Create snapshot completed successfully
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['493c0041-46e5-4d8a-8c0b-9caad65961d5'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:40 devstack cinder-volume[83140]: WARNING cinder.quota [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1288913491 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1288913491, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:06:40 devstack cinder-volume[83140]: WARNING cinder.quota [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1288913491 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1288913491, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['33eb5fc3-f5dd-4eb8-ab8b-2ca4d21396b6', 'd73f057a-1d17-4ba3-9237-41bb25d8b457', '6124e4d1-b0fc-4d1f-b1ee-a6ddba0cf238', 'f5533613-69c5-4e96-a787-553ea4328b58'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:40 devstack sudo[87914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:40 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:41 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053 1073741824" returned: 0 in 0.681s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:41 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.536s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:41 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6d33674d-7828-4dbe-874a-abdf19683f94 tempest-GroupSnapshotsTest-76967834 None] Delete group completed successfully.
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:41 devstack sudo[87926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053
Feb 27 02:06:41 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:41 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] group_snapshot b806467b-bc39-4686-babc-5a5486fc004b: deleting
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] group_snapshot b806467b-bc39-4686-babc-5a5486fc004b: deleting {{(pid=83140) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-be141167-b7fd-48b3-bbd9-5b4366da109e" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-be141167-b7fd-48b3-bbd9-5b4366da109e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-405e87f9-d2d6-4551-b31b-d1e09abd151b" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-405e87f9-d2d6-4551-b31b-d1e09abd151b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Deleting offline snapshot 405e87f9-d2d6-4551-b31b-d1e09abd151b of volume be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] snapshot_file for this snap is: volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[95638c5f-0b5e-4d8d-a999-4e3a506f829b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-17ab47e1-6c68-407e-9efd-fc08cea1c674-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-17ab47e1-6c68-407e-9efd-fc08cea1c674-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:41 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053" returned: 0 in 0.529s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-quobyte-17ab47e1-6c68-407e-9efd-fc08cea1c674" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.745s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-492939770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861b80bf-120a-4cad-a217-6b784635d994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:37Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Creating volume 861b80bf-120a-4cad-a217-6b784635d994 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:41 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83018d3-b5a6-437c-a73c-b6a1cb899ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3c9116-1e52-408b-99be-58992b3af053', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf83a8f9-9426-426b-b99a-2ef29b94f577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:41 devstack sudo[87930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994 1073741824
Feb 27 02:06:41 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-17ab47e1-6c68-407e-9efd-fc08cea1c674" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Deleting offline snapshot 17ab47e1-6c68-407e-9efd-fc08cea1c674 of volume f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:06:41 devstack sudo[87929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b
Feb 27 02:06:41 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] snapshot_file for this snap is: volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:06:41 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Volume volume-1f3c9116-1e52-408b-99be-58992b3af053 (1f3c9116-1e52-408b-99be-58992b3af053): created successfully
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf83a8f9-9426-426b-b99a-2ef29b94f577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Flow 'volume_create_manager' (d6a4885d-539a-42cb-9778-3735b17982b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba804ff4-fbb1-4010-abe4-dd033b79362e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:41 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-41f46064-4abd-45b3-a469-393ae0f34fdc tempest-VolumesListTestJSON-1697759733 None] Created volume successfully.
Feb 27 02:06:41 devstack sudo[87933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674
Feb 27 02:06:41 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:42 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b" returned: 0 in 0.675s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be141167-b7fd-48b3-bbd9-5b4366da109e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8dd65e-342c-43b4-91db-eefa79c11ff8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:42 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994 1073741824" returned: 0 in 0.608s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:42 devstack sudo[87942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994
Feb 27 02:06:42 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:42 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e
Feb 27 02:06:42 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:42 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674" returned: 0 in 0.668s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f281757d-2d4e-42a5-9b62-2096c943d7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae51414-53c6-4ec5-97fe-a8a3fe1e8cd3]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:42 devstack sudo[87948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c
Feb 27 02:06:42 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:42 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994" returned: 0 in 0.548s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a99250d-cbbf-40f4-b3d4-ef2fecb7a0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861b80bf-120a-4cad-a217-6b784635d994', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150055c9-a794-4b95-8e74-57792ec279ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:42 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e" returned: 0 in 0.623s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:42 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Volume volume-861b80bf-120a-4cad-a217-6b784635d994 (861b80bf-120a-4cad-a217-6b784635d994): created successfully
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150055c9-a794-4b95-8e74-57792ec279ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:42 devstack sudo[87955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b
Feb 27 02:06:42 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (1afb4d21-e058-47c1-b8b8-d3746d1d067d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:42 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:42 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4ee00140-aaf9-41eb-af20-5fdb02788f95 tempest-VolumesActionsTest-1876194107 None] Created volume successfully.
Feb 27 02:06:43 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" returned: 0 in 0.674s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f281757d-2d4e-42a5-9b62-2096c943d7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:43 devstack sudo[87960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674
Feb 27 02:06:43 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-de0281fc-8775-4c7b-9ade-69741d82cbe8 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "cinder-861b80bf-120a-4cad-a217-6b784635d994" by "attach_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-de0281fc-8775-4c7b-9ade-69741d82cbe8 tempest-VolumesActionsTest-1876194107 None] Lock "cinder-861b80bf-120a-4cad-a217-6b784635d994" acquired by "attach_volume" :: waited 0.058s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Flow 'volume_create_manager' (f39ad525-d2b0-4f9c-a804-d3e8837db860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f7bd71-df96-44d5-b7cd-e302182c8641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f7bd71-df96-44d5-b7cd-e302182c8641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1135856559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308b7e28-e5c2-4b08-8f67-37eb541b024c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1865ddef51945538f8b9195153120fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:43Z,use_quota=True,user_id='5bef27838c1c4a7d93c87048aa5d20c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5556b63f-22a0-4741-92ab-849c9d205503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5556b63f-22a0-4741-92ab-849c9d205503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ae4808-1a8b-48a4-8cc2-aca44da840fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ae4808-1a8b-48a4-8cc2-aca44da840fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308b7e28-e5c2-4b08-8f67-37eb541b024c', 'volume_name': 'volume-308b7e28-e5c2-4b08-8f67-37eb541b024c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da5e280-ba55-49ae-be70-986201b6bd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da5e280-ba55-49ae-be70-986201b6bd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d5c601-9d77-48fb-a70a-c4e7deb3787e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:43 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Volume 308b7e28-e5c2-4b08-8f67-37eb541b024c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308b7e28-e5c2-4b08-8f67-37eb541b024c', 'volume_size': 1}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1135856559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308b7e28-e5c2-4b08-8f67-37eb541b024c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1865ddef51945538f8b9195153120fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:43Z,use_quota=True,user_id='5bef27838c1c4a7d93c87048aa5d20c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Creating volume 308b7e28-e5c2-4b08-8f67-37eb541b024c {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:43 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:43 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c 1073741824
Feb 27 02:06:43 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:43 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-de0281fc-8775-4c7b-9ade-69741d82cbe8 tempest-VolumesActionsTest-1876194107 None] Attaching volume 861b80bf-120a-4cad-a217-6b784635d994 to instance 2508ebce-1782-4515-8b51-7e23f6dbfbbb at mountpoint /dev/vdb on host None.
Feb 27 02:06:43 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-de0281fc-8775-4c7b-9ade-69741d82cbe8 tempest-VolumesActionsTest-1876194107 None] Attach volume completed successfully.
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-de0281fc-8775-4c7b-9ade-69741d82cbe8 tempest-VolumesActionsTest-1876194107 None] Lock "cinder-861b80bf-120a-4cad-a217-6b784635d994" released by "attach_volume" :: held 0.175s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:43 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b" returned: 0 in 0.679s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:43 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b
Feb 27 02:06:43 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:43 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674" returned: 0 in 0.683s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:43 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674
Feb 27 02:06:43 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:44 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c 1073741824" returned: 0 in 0.676s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:44 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e.405e87f9-d2d6-4551-b31b-d1e09abd151b" returned: 0 in 0.579s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:44 devstack sudo[87978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c
Feb 27 02:06:44 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-405e87f9-d2d6-4551-b31b-d1e09abd151b" released by "_delete_snapshot" :: held 2.646s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-be141167-b7fd-48b3-bbd9-5b4366da109e" released by "delete_snapshot" :: held 2.675s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:44 devstack cinder-volume[83140]: WARNING cinder.quota [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1288913491 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1288913491, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['747b3bd1-322a-4722-bca5-b47f404bc6dd', 'a7f3ada6-9e2a-474e-bf3a-18ad32396434', '5078b7fd-1cb8-4ea2-a088-a4fc3a94f37b', '1e2990b5-5a15-4d1c-a756-2320ed9b8208'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:44 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3ca61019-e895-442c-8b4d-7dfec2353dad tempest-VolumesActionsTest-1695222663 None] Terminate volume connection completed successfully.
Feb 27 02:06:44 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-cdcb2adf-62df-4605-b105-f2c4c7220f48 tempest-GroupSnapshotsTest-76967834 None] group_snapshot b806467b-bc39-4686-babc-5a5486fc004b: deleted successfully
Feb 27 02:06:44 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.17ab47e1-6c68-407e-9efd-fc08cea1c674" returned: 0 in 0.659s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-17ab47e1-6c68-407e-9efd-fc08cea1c674" released by "_delete_snapshot" :: held 2.789s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" released by "delete_snapshot" :: held 2.865s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Created reservations ['565cb72c-8535-452d-85a9-032bfd1a4ff3', 'd717f57f-1458-48f6-bde6-006c990f4463', '9d8f4a80-a4aa-4857-a33a-c479cc36b8d3', 'dcb8148e-16d3-4ec3-8545-c6ec66bb06c6'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:44 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Delete snapshot completed successfully.
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-057c6b73-571d-411c-8cff-bed31b403756 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-17ab47e1-6c68-407e-9efd-fc08cea1c674-delete_snapshot" released by "delete_snapshot" :: held 2.986s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:44 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c" returned: 0 in 0.530s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d5c601-9d77-48fb-a70a-c4e7deb3787e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308b7e28-e5c2-4b08-8f67-37eb541b024c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd82974-1207-4c3b-8243-2081a28f73c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:44 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Volume volume-308b7e28-e5c2-4b08-8f67-37eb541b024c (308b7e28-e5c2-4b08-8f67-37eb541b024c): created successfully
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd82974-1207-4c3b-8243-2081a28f73c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Flow 'volume_create_manager' (f39ad525-d2b0-4f9c-a804-d3e8837db860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:44 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1540e162-9958-4fac-82e2-141824a47f5c tempest-VolumesListTestJSON-1697759733 None] Created volume successfully.
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3ca61019-e895-442c-8b4d-7dfec2353dad tempest-VolumesActionsTest-1695222663 None] Acquiring lock "cinder-861b80bf-120a-4cad-a217-6b784635d994-detach_volume" by "detach_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3ca61019-e895-442c-8b4d-7dfec2353dad tempest-VolumesActionsTest-1695222663 None] Lock "cinder-861b80bf-120a-4cad-a217-6b784635d994-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:44 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3ca61019-e895-442c-8b4d-7dfec2353dad tempest-VolumesActionsTest-1695222663 None] Detaching volume 861b80bf-120a-4cad-a217-6b784635d994 from instance 2508ebce-1782-4515-8b51-7e23f6dbfbbb.
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-quobyte-b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Deleting offline snapshot b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c of volume f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] snapshot_file for this snap is: volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ec68e5-830c-4cbe-a8d9-8096d20abbac]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:44 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3ca61019-e895-442c-8b4d-7dfec2353dad tempest-VolumesActionsTest-1695222663 None] Detach volume completed successfully.
Feb 27 02:06:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3ca61019-e895-442c-8b4d-7dfec2353dad tempest-VolumesActionsTest-1695222663 None] Lock "cinder-861b80bf-120a-4cad-a217-6b784635d994-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:45 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c
Feb 27 02:06:45 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-be141167-b7fd-48b3-bbd9-5b4366da109e" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-be141167-b7fd-48b3-bbd9-5b4366da109e" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72460fe-0eca-4338-9020-a272a6b2c9fe]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:45 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e
Feb 27 02:06:45 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-af1fa1d7-49e7-4268-a4b6-ea67e69ac2f1 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "cinder-861b80bf-120a-4cad-a217-6b784635d994-detach_volume" by "detach_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-af1fa1d7-49e7-4268-a4b6-ea67e69ac2f1 tempest-VolumesActionsTest-1876194107 None] Lock "cinder-861b80bf-120a-4cad-a217-6b784635d994-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:45 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-af1fa1d7-49e7-4268-a4b6-ea67e69ac2f1 tempest-VolumesActionsTest-1876194107 None] Volume detach called, but volume not attached.
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-af1fa1d7-49e7-4268-a4b6-ea67e69ac2f1 tempest-VolumesActionsTest-1876194107 None] Lock "cinder-861b80bf-120a-4cad-a217-6b784635d994-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:45 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" returned: 0 in 0.623s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f281757d-2d4e-42a5-9b62-2096c943d7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05c189-90ca-49d6-bdd5-8533b901f3d2]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:45 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef
Feb 27 02:06:45 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:45 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e" returned: 0 in 0.681s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:45 devstack sudo[87994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e
Feb 27 02:06:45 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Acquiring lock "cinder-861b80bf-120a-4cad-a217-6b784635d994-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:46 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Lock "cinder-861b80bf-120a-4cad-a217-6b784635d994-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef" returned: 0 in 0.683s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f281757d-2d4e-42a5-9b62-2096c943d7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:46 devstack sudo[87999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c
Feb 27 02:06:46 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Acquiring lock "cinder-quobyte-861b80bf-120a-4cad-a217-6b784635d994" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Lock "cinder-quobyte-861b80bf-120a-4cad-a217-6b784635d994" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddda206-f4d5-430a-a425-9f9c87dd4568]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:46 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994
Feb 27 02:06:46 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:46 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-be141167-b7fd-48b3-bbd9-5b4366da109e" returned: 0 in 0.631s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-be141167-b7fd-48b3-bbd9-5b4366da109e" released by "delete_volume" :: held 1.353s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['d09e2b2b-a52c-4356-9015-e0ad83cb594b'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:46 devstack cinder-volume[83140]: WARNING cinder.db.sqlalchemy.api [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1288913491']
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['5dcd705b-3034-45b4-8bdc-a58e5cba3570', '5ab80fd6-7f9d-46fb-8b90-80133452dad3', 'c3b2b27a-130d-46a4-8056-2c66f8b3a49e', '5ea893b5-8d02-489c-9c0c-7edd78f4ef98'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:46 devstack sudo[88007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:46 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:46 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" returned: 0 in 0.673s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:46 devstack sudo[88009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c
Feb 27 02:06:46 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:47 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994" returned: 0 in 0.865s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:47 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994
Feb 27 02:06:47 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:47 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.766s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-a144fd47-56ec-46d7-bc62-feea4352d7e0 tempest-GroupSnapshotsTest-76967834 None] Delete group completed successfully.
Feb 27 02:06:47 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" returned: 0 in 0.758s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c" released by "_delete_snapshot" :: held 2.819s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" released by "delete_snapshot" :: held 2.836s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Created reservations ['bcace170-c197-42cc-a2ba-d606d12fe656', '38331822-6f69-4222-816e-6a76a3885a10', '6ff9ec61-4aeb-48c9-bc71-14acfa0a2323', 'd8e0434c-b0af-4912-b391-0cbbba8bc6f6'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Delete snapshot completed successfully.
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5c8848d-7e68-4081-8d70-6a4a626786e6 tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-b590c81c-9cc5-4bc9-b36a-d7be7bee0e1c-delete_snapshot" released by "delete_snapshot" :: held 3.027s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:47 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-861b80bf-120a-4cad-a217-6b784635d994" returned: 0 in 0.719s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Lock "cinder-quobyte-861b80bf-120a-4cad-a217-6b784635d994" released by "delete_volume" :: held 1.607s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Created reservations ['5b21004c-d40b-4a7d-9b6f-f0e90fe9c7d1', 'bc452332-d145-4e63-9729-aa55aad757c9', 'd90ce084-4445-4664-b50a-0879198bf5fe', '7447010b-4db8-4fcd-a547-12feec52581d'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-336bfeb2-af50-4ea7-884b-f3ee70646433 tempest-GroupSnapshotsTest-76967834 None] Group tempest-GroupSnapshotsTest-Group-1193597397: creating
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "cinder-308b7e28-e5c2-4b08-8f67-37eb541b024c-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-23de94de-fc39-4629-9fed-87a1326a67ef-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-308b7e28-e5c2-4b08-8f67-37eb541b024c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-23de94de-fc39-4629-9fed-87a1326a67ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-336bfeb2-af50-4ea7-884b-f3ee70646433 tempest-GroupSnapshotsTest-76967834 None] Group tempest-GroupSnapshotsTest-Group-1193597397: created successfully
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-quobyte-23de94de-fc39-4629-9fed-87a1326a67ef" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-336bfeb2-af50-4ea7-884b-f3ee70646433 tempest-GroupSnapshotsTest-76967834 None] Create group completed successfully.
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-23de94de-fc39-4629-9fed-87a1326a67ef" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Deleting offline snapshot 23de94de-fc39-4629-9fed-87a1326a67ef of volume f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] snapshot_file for this snap is: volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "cinder-quobyte-308b7e28-e5c2-4b08-8f67-37eb541b024c" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1768390b-bf38-445b-ae69-9f494daf232a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-quobyte-308b7e28-e5c2-4b08-8f67-37eb541b024c" acquired by "delete_volume" :: waited 0.038s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:48 devstack sudo[88021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:48 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae6b382-777d-4721-8b86-1d0619894707]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:48 devstack sudo[88020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef
Feb 27 02:06:48 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:48 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c
Feb 27 02:06:48 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:48 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.530s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Deleted volume successfully.
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1d469028-1e87-48bc-9ff2-4285ed7d414d tempest-VolumesActionsTest-1876194107 None] Lock "cinder-861b80bf-120a-4cad-a217-6b784635d994-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:48 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef" returned: 0 in 0.629s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f281757d-2d4e-42a5-9b62-2096c943d7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0fc798-a58f-4959-b39a-b2864c6c5df7]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:48 devstack sudo[88030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3
Feb 27 02:06:48 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:49 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c" returned: 0 in 0.767s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:49 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c
Feb 27 02:06:49 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Flow 'volume_create_manager' (7e452333-0867-4329-a28b-5c5249a43e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57776994-e86c-4249-8ff2-417513c57944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57776994-e86c-4249-8ff2-417513c57944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444414468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78784ad5-44c5-4064-91e9-8ec2c92a92e9,host='devstack@QuobyteHD#QuobyteHD',id=133c75d5-a474-4720-84ea-c8bd3f4d5ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9425def193be4b788fb7fcee43d02a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:49Z,use_quota=True,user_id='99af59ded704483181a4ee37662ebe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d598d8a8-c26a-454f-b561-5220d9249d4c),volume_type_id=d598d8a8-c26a-454f-b561-5220d9249d4c)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b0aebc-22a5-4724-aa61-44b7d8eef344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b0aebc-22a5-4724-aa61-44b7d8eef344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b615c69a-bca0-4df8-a003-25de9fbbbb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b615c69a-bca0-4df8-a003-25de9fbbbb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133c75d5-a474-4720-84ea-c8bd3f4d5ff3', 'volume_name': 'volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1a935f-3b8f-4856-a4ae-b4039360aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1a935f-3b8f-4856-a4ae-b4039360aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a272f085-be8f-4f07-a3fc-c645c34d4a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:49 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:49 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Volume 133c75d5-a474-4720-84ea-c8bd3f4d5ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3', 'volume_size': 1}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78784ad5-44c5-4064-91e9-8ec2c92a92e9,created_at=2026-02-27T01:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444414468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78784ad5-44c5-4064-91e9-8ec2c92a92e9,host='devstack@QuobyteHD#QuobyteHD',id=133c75d5-a474-4720-84ea-c8bd3f4d5ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9425def193be4b788fb7fcee43d02a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:49Z,use_quota=True,user_id='99af59ded704483181a4ee37662ebe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d598d8a8-c26a-454f-b561-5220d9249d4c),volume_type_id=d598d8a8-c26a-454f-b561-5220d9249d4c)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Creating volume 133c75d5-a474-4720-84ea-c8bd3f4d5ff3 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:49 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3" returned: 0 in 0.701s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:49 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 1073741824
Feb 27 02:06:49 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:49 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef
Feb 27 02:06:49 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:49 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-308b7e28-e5c2-4b08-8f67-37eb541b024c" returned: 0 in 0.594s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-quobyte-308b7e28-e5c2-4b08-8f67-37eb541b024c" released by "delete_volume" :: held 1.389s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Created reservations ['d86fc705-7dbf-4839-ba8a-4435a9998b6e', 'fa020e27-e8fd-4c76-a742-ffb9b01f2874', 'b4776b28-a825-4de7-85e2-f93fa86f7733', '8891ab2a-8669-4aa5-bfb8-3da0d09e51f9'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:49 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:49 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:50 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef" returned: 0 in 0.710s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:50 devstack sudo[88078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef
Feb 27 02:06:50 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:50 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 1073741824" returned: 0 in 0.817s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "cinder-1f3c9116-1e52-408b-99be-58992b3af053-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:50 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3
Feb 27 02:06:50 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-1f3c9116-1e52-408b-99be-58992b3af053-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "cinder-quobyte-1f3c9116-1e52-408b-99be-58992b3af053" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-quobyte-1f3c9116-1e52-408b-99be-58992b3af053" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a534ffee-12bd-42ef-bdc3-f6e6fecab416]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:50 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.761s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:50 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Deleted volume successfully.
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-91361d1f-e15e-47ab-9b8e-7aa23b76e38a tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-308b7e28-e5c2-4b08-8f67-37eb541b024c-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:50 devstack sudo[88084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053
Feb 27 02:06:50 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:50 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3.23de94de-fc39-4629-9fed-87a1326a67ef" returned: 0 in 0.612s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-23de94de-fc39-4629-9fed-87a1326a67ef" released by "_delete_snapshot" :: held 2.721s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" released by "delete_snapshot" :: held 2.752s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Created reservations ['b2d089b7-a4bc-4c2a-a9b0-ff476b323fbb', '8a98c922-f738-4934-9aba-bcd12475d9ff', '46cb86f7-d4ab-488c-9281-758a43c6a073', 'b831f9fe-1e78-4061-b02e-9f7c9a954295'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:50 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" returned: 0 in 0.570s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a272f085-be8f-4f07-a3fc-c645c34d4a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5227e1b7-8977-4431-a015-5828bd06c18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:50 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Volume volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 (133c75d5-a474-4720-84ea-c8bd3f4d5ff3): created successfully
Feb 27 02:06:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5227e1b7-8977-4431-a015-5828bd06c18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Flow 'volume_create_manager' (7e452333-0867-4329-a28b-5c5249a43e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e4e7f38d-5095-450e-8f48-7e1858295979 tempest-GroupSnapshotsTest-76967834 None] Created volume successfully.
Feb 27 02:06:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Delete snapshot completed successfully.
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f7566d3e-2779-482a-8fde-c94ca18a09be tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-23de94de-fc39-4629-9fed-87a1326a67ef-delete_snapshot" released by "delete_snapshot" :: held 2.904s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:51 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053" returned: 0 in 0.540s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:51 devstack sudo[88091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053
Feb 27 02:06:51 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-f281757d-2d4e-42a5-9b62-2096c943d7b3-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-f281757d-2d4e-42a5-9b62-2096c943d7b3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8227e3-4cc2-4475-be1b-eda8dd55aa54]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:51 devstack sudo[88093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3
Feb 27 02:06:51 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:51 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1f3c9116-1e52-408b-99be-58992b3af053" returned: 0 in 0.641s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-quobyte-1f3c9116-1e52-408b-99be-58992b3af053" released by "delete_volume" :: held 1.214s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Created reservations ['5a0cb554-73c2-4ed2-bc60-b2f8787a0097', 'e1587823-23d6-4372-a8a1-d2b3bdeafa69', 'b3020877-add4-4bcc-92b3-38f0bdebe232', 'd62db5ec-738c-4156-9c7f-346b839186df'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:51 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:51 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Flow 'volume_create_manager' (94fa8535-e2b0-4471-b0b7-94fe76623541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17aced6-27e5-4769-9ac7-b87bba7391ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17aced6-27e5-4769-9ac7-b87bba7391ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535978233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78784ad5-44c5-4064-91e9-8ec2c92a92e9,host='devstack@QuobyteHD#QuobyteHD',id=d1c0078b-7c63-4c37-9acd-3ba5fd840f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9425def193be4b788fb7fcee43d02a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:52Z,use_quota=True,user_id='99af59ded704483181a4ee37662ebe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d598d8a8-c26a-454f-b561-5220d9249d4c),volume_type_id=d598d8a8-c26a-454f-b561-5220d9249d4c)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37495144-81a2-4755-a920-7ff2d98f0270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37495144-81a2-4755-a920-7ff2d98f0270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba5f6d5-59f9-4863-b0f3-e411ea8d6d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba5f6d5-59f9-4863-b0f3-e411ea8d6d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c0078b-7c63-4c37-9acd-3ba5fd840f2c', 'volume_name': 'volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23895420-fbd8-4d31-befb-8d8af7f5bb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23895420-fbd8-4d31-befb-8d8af7f5bb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70380c6b-8407-4bb4-a66f-fdf81c5c9add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:52 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Volume d1c0078b-7c63-4c37-9acd-3ba5fd840f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c', 'volume_size': 1}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78784ad5-44c5-4064-91e9-8ec2c92a92e9,created_at=2026-02-27T01:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535978233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78784ad5-44c5-4064-91e9-8ec2c92a92e9,host='devstack@QuobyteHD#QuobyteHD',id=d1c0078b-7c63-4c37-9acd-3ba5fd840f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9425def193be4b788fb7fcee43d02a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:52Z,use_quota=True,user_id='99af59ded704483181a4ee37662ebe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d598d8a8-c26a-454f-b561-5220d9249d4c),volume_type_id=d598d8a8-c26a-454f-b561-5220d9249d4c)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Creating volume d1c0078b-7c63-4c37-9acd-3ba5fd840f2c {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:52 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:52 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c 1073741824
Feb 27 02:06:52 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:52 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3" returned: 0 in 0.779s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:52 devstack sudo[88104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3
Feb 27 02:06:52 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:52 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.588s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:52 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Deleted volume successfully.
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-2a9ae0f9-5556-4232-8348-14a500ffadc9 tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-1f3c9116-1e52-408b-99be-58992b3af053-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:52 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c 1073741824" returned: 0 in 0.666s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "cinder-50af6d04-4364-4156-961a-0950f2bf0bd3-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:52 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f281757d-2d4e-42a5-9b62-2096c943d7b3" returned: 0 in 0.626s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:52 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c
Feb 27 02:06:52 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-quobyte-f281757d-2d4e-42a5-9b62-2096c943d7b3" released by "delete_volume" :: held 1.450s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-50af6d04-4364-4156-961a-0950f2bf0bd3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Created reservations ['5eb39530-576f-4b4d-9c0b-c0ee14fdc4da', 'e88c7745-6af1-4507-888e-7ae6d996877d', 'b4e0b6bd-a0a0-4fd1-82b7-0a3bae506d7f', '4173a3ac-efcd-402b-b653-db070fa1c83c'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "cinder-quobyte-50af6d04-4364-4156-961a-0950f2bf0bd3" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-quobyte-50af6d04-4364-4156-961a-0950f2bf0bd3" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc0419-a57b-4b9f-83aa-ca1bef3b9fa5]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:53 devstack sudo[88115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:53 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:53 devstack sudo[88114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3
Feb 27 02:06:53 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:53 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" returned: 0 in 0.475s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70380c6b-8407-4bb4-a66f-fdf81c5c9add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21aca6a-337d-45fd-a24e-d18a207bfed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:53 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Volume volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c (d1c0078b-7c63-4c37-9acd-3ba5fd840f2c): created successfully
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21aca6a-337d-45fd-a24e-d18a207bfed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Flow 'volume_create_manager' (94fa8535-e2b0-4471-b0b7-94fe76623541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:53 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-cad8e277-47e1-42bf-94b9-cd4164db7ccc tempest-GroupSnapshotsTest-76967834 None] Created volume successfully.
Feb 27 02:06:53 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:53 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.498s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3" returned: 0 in 0.542s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:53 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Deleted volume successfully.
Feb 27 02:06:53 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3
Feb 27 02:06:53 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a81c10da-02d0-4b70-a071-f04685ca34ab tempest-VolumesSnapshotListTestJSON-1140024695 None] Lock "cinder-f281757d-2d4e-42a5-9b62-2096c943d7b3-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:54 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-50af6d04-4364-4156-961a-0950f2bf0bd3" returned: 0 in 0.506s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-quobyte-50af6d04-4364-4156-961a-0950f2bf0bd3" released by "delete_volume" :: held 1.070s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Created reservations ['8e7d3c88-35ea-4087-9b19-010c23005f86', '4e2fc44a-5b1a-4c7a-861e-0c9413f5f82a', 'e5534864-87f6-48d4-814e-8a5543d3ac17', '2e38c7ea-b971-40b8-9442-d8b7eb2a56f7'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:54 devstack sudo[88126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:54 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:54 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-081b9ad6-f50c-45ee-96f5-f2c472011f15 tempest-GroupSnapshotsTest-76967834 None] Update group completed successfully.
Feb 27 02:06:54 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.565s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:54 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Deleted volume successfully.
Feb 27 02:06:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2f7c84d-2294-471b-a8d6-d231ead3994f tempest-VolumesListTestJSON-1697759733 None] Lock "cinder-50af6d04-4364-4156-961a-0950f2bf0bd3-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (386cc1ee-0390-43c0-9e83-79d146488666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c00eb4c-e62b-4d8e-8d53-240c4876cbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c00eb4c-e62b-4d8e-8d53-240c4876cbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1727554198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3b8546-72cb-4f88-9c8b-e2a351f40ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:55Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b242e8-8636-47cd-ab66-e68a5e8cfb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b242e8-8636-47cd-ab66-e68a5e8cfb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425088f7-ae01-4521-81be-5013f3656ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425088f7-ae01-4521-81be-5013f3656ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3b8546-72cb-4f88-9c8b-e2a351f40ada', 'volume_name': 'volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe353eb8-7e50-4a14-b507-d3056a3b543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe353eb8-7e50-4a14-b507-d3056a3b543f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc54c51-9ed5-473b-b15e-759d3655b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Volume 8b3b8546-72cb-4f88-9c8b-e2a351f40ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada', 'volume_size': 1}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1727554198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3b8546-72cb-4f88-9c8b-e2a351f40ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:55Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Creating volume 8b3b8546-72cb-4f88-9c8b-e2a351f40ada {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:55 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:55 devstack sudo[88130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada 1073741824
Feb 27 02:06:55 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-fcf8d7dc-eced-4a5a-a974-90d533c479bb tempest-GroupSnapshotsTest-76967834 None] Update group completed successfully.
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (633e3e9b-60ff-4b58-a939-7ac14ab683cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7f0f9f-5184-40f6-9274-c0238a77db67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7f0f9f-5184-40f6-9274-c0238a77db67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-50955210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:56Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d58a00-7c16-4deb-b0bd-0a8c0b93fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d58a00-7c16-4deb-b0bd-0a8c0b93fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752688d5-fea8-4ddf-9d54-95e9e1a98761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752688d5-fea8-4ddf-9d54-95e9e1a98761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769', 'volume_name': 'volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27403645-e282-4962-8824-17aa3d826fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27403645-e282-4962-8824-17aa3d826fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6130f3ef-3296-49cd-b34c-e39030711ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:55 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Volume 0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769', 'volume_size': 1}
Feb 27 02:06:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (3d1a2803-373f-45ed-a533-4052e035c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c76c5f1-dc5a-4234-912b-41ec8a0b832f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c76c5f1-dc5a-4234-912b-41ec8a0b832f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523486072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cd143a-e0d6-44f4-ac33-1cc1a620b676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:56Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ba4641-aa3f-48f3-a9be-18e038c612ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ba4641-aa3f-48f3-a9be-18e038c612ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c04fd6-f1fc-4dff-8b8b-2e028cf7862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c04fd6-f1fc-4dff-8b8b-2e028cf7862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72cd143a-e0d6-44f4-ac33-1cc1a620b676', 'volume_name': 'volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3ad507-1e0d-48ee-aff2-181d796567ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3ad507-1e0d-48ee-aff2-181d796567ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee07222b-9317-4c4f-8905-60e772047122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Volume 72cd143a-e0d6-44f4-ac33-1cc1a620b676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676', 'volume_size': 1}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada 1073741824" returned: 0 in 0.754s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:56 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada
Feb 27 02:06:56 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (68f07d99-49b9-4003-b02f-d04ce203307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57487918-cd3c-455c-bb82-ac7f08c67f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57487918-cd3c-455c-bb82-ac7f08c67f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99879833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c642eac5-d888-409c-9310-1dc7e2a36d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:56Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463747bf-6fbe-481f-9a96-e1ba94d6815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463747bf-6fbe-481f-9a96-e1ba94d6815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722e44bd-1e79-48e7-9a10-5a22756577bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722e44bd-1e79-48e7-9a10-5a22756577bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c642eac5-d888-409c-9310-1dc7e2a36d81', 'volume_name': 'volume-c642eac5-d888-409c-9310-1dc7e2a36d81', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081d4e43-ea42-4a78-8d9e-4994c7f48d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081d4e43-ea42-4a78-8d9e-4994c7f48d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd59b4a-d3bb-4624-adef-efff115783f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Volume c642eac5-d888-409c-9310-1dc7e2a36d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c642eac5-d888-409c-9310-1dc7e2a36d81', 'volume_size': 1}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (1ac71ab0-3a97-4024-8c7c-e91e3bc36f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8f7f0d-18df-4367-bb7f-deaa1f201904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8f7f0d-18df-4367-bb7f-deaa1f201904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-812725800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40aa5f22-2409-466b-91db-4e05f8795eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180bbf35-0a7e-483f-9c69-c1ed61f029ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180bbf35-0a7e-483f-9c69-c1ed61f029ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a5bee1-8371-4aea-83fb-cbaffcd10ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a5bee1-8371-4aea-83fb-cbaffcd10ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40aa5f22-2409-466b-91db-4e05f8795eab', 'volume_name': 'volume-40aa5f22-2409-466b-91db-4e05f8795eab', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3180d3a7-9b43-42a4-9f57-c567876d15da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3180d3a7-9b43-42a4-9f57-c567876d15da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce7e922-9347-4e84-ae19-2c4a45287fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Volume 40aa5f22-2409-466b-91db-4e05f8795eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40aa5f22-2409-466b-91db-4e05f8795eab', 'volume_size': 1}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada" returned: 0 in 0.536s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-50955210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:56Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Creating volume 0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:56 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc54c51-9ed5-473b-b15e-759d3655b488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack sudo[88138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769 1073741824
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0006ef-1771-47d6-913f-cdd694075b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Volume volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada (8b3b8546-72cb-4f88-9c8b-e2a351f40ada): created successfully
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0006ef-1771-47d6-913f-cdd694075b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (386cc1ee-0390-43c0-9e83-79d146488666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:56 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2fd0d522-166d-4592-a7bf-a8c6d37c71b8 tempest-VolumesActionsTest-1876194107 None] Created volume successfully.
Feb 27 02:06:56 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8b0e30e0-fafb-47ef-a2c2-d3fb15576a13 tempest-GroupSnapshotsTest-76967834 None] Update group completed successfully.
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (07142566-1bd4-4aa4-9450-40ca3a9f73bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875ec57-0d77-43c8-a0a6-9ca88b9100ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875ec57-0d77-43c8-a0a6-9ca88b9100ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-801716122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e052f3-f670-4c82-9477-0e732486d83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e957aa-1569-4333-8267-5ad2dd76c74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e957aa-1569-4333-8267-5ad2dd76c74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3895f3ad-5b52-4030-b336-ce1cb751ae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3895f3ad-5b52-4030-b336-ce1cb751ae45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e052f3-f670-4c82-9477-0e732486d83e', 'volume_name': 'volume-34e052f3-f670-4c82-9477-0e732486d83e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdeedd02-f4e9-48ad-ad87-77813bf04586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdeedd02-f4e9-48ad-ad87-77813bf04586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e10b08-ddd2-4e13-a888-5af26d02899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Volume 34e052f3-f670-4c82-9477-0e732486d83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e052f3-f670-4c82-9477-0e732486d83e', 'volume_size': 1}
Feb 27 02:06:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:06:57 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Flow 'volume_create_manager' (21ecd794-1cba-4ddd-8e59-8301f9c03eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f52087-29a3-48d9-b6d9-1b3eb3ae8215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769 1073741824" returned: 0 in 0.659s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f52087-29a3-48d9-b6d9-1b3eb3ae8215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64a7978-8c72-4121-891e-f944eefa47c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ece535307649fe80f37ebf9b5ffb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='989216151bbb4f6eadcd8e226582fb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c9e36-d794-4b55-ad07-2b5bf4f4deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c9e36-d794-4b55-ad07-2b5bf4f4deb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1ead98-1060-48ce-9ad2-5c806051a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1ead98-1060-48ce-9ad2-5c806051a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64a7978-8c72-4121-891e-f944eefa47c6', 'volume_name': 'volume-d64a7978-8c72-4121-891e-f944eefa47c6', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29eef5ae-0678-4314-b0b0-8c8da9fc37e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29eef5ae-0678-4314-b0b0-8c8da9fc37e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88b5d14-776b-4c60-911b-07afb967666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Volume d64a7978-8c72-4121-891e-f944eefa47c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64a7978-8c72-4121-891e-f944eefa47c6', 'volume_size': 1}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:57 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769
Feb 27 02:06:57 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Acquiring lock "cinder-8b3b8546-72cb-4f88-9c8b-e2a351f40ada-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Lock "cinder-8b3b8546-72cb-4f88-9c8b-e2a351f40ada-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Acquiring lock "cinder-quobyte-8b3b8546-72cb-4f88-9c8b-e2a351f40ada" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Lock "cinder-quobyte-8b3b8546-72cb-4f88-9c8b-e2a351f40ada" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dfb181-75ac-4384-816d-e1c9def92466]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:57 devstack sudo[88147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada
Feb 27 02:06:57 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:57 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0a82c659-a783-46f3-a90c-0b1860a0e259 tempest-GroupSnapshotsTest-76967834 None] Update group completed successfully.
Feb 27 02:06:57 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769" returned: 0 in 0.501s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523486072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cd143a-e0d6-44f4-ac33-1cc1a620b676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:56Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Creating volume 72cd143a-e0d6-44f4-ac33-1cc1a620b676 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:57 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:57 devstack sudo[88150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676 1073741824
Feb 27 02:06:57 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6130f3ef-3296-49cd-b34c-e39030711ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8e4b05-af47-4bf3-833f-54774e3bed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Volume volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769 (0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769): created successfully
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8e4b05-af47-4bf3-833f-54774e3bed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (633e3e9b-60ff-4b58-a939-7ac14ab683cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:58 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-dd36751d-b75b-4ac7-a07b-b151d09435cc tempest-CreateVolumesFromImageTest-1219033328 None] Created volume successfully.
Feb 27 02:06:58 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada" returned: 0 in 0.540s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:58 devstack sudo[88155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada
Feb 27 02:06:58 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:58 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676 1073741824" returned: 0 in 0.583s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:58 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676
Feb 27 02:06:58 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:58 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-8b3b8546-72cb-4f88-9c8b-e2a351f40ada" returned: 0 in 0.457s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Lock "cinder-quobyte-8b3b8546-72cb-4f88-9c8b-e2a351f40ada" released by "delete_volume" :: held 1.026s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Created reservations ['2de0bf8b-63d6-482e-9952-25d1fa184b23', 'd2b46e2e-dd53-48b6-8a01-b654d048364b', '321c0a76-ef5c-4889-8f0e-f1c29e66dc92', 'd6e473da-af85-4e2c-b89f-871bb9b5ae25'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:58 devstack sudo[88163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:06:58 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:59 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676" returned: 0 in 0.506s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.653s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99879833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c642eac5-d888-409c-9310-1dc7e2a36d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:56Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Creating volume c642eac5-d888-409c-9310-1dc7e2a36d81 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:06:59 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee07222b-9317-4c4f-8905-60e772047122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f001ff-3059-4892-a4d2-b84501f1e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:06:59 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81 1073741824
Feb 27 02:06:59 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:06:59 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Volume volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676 (72cd143a-e0d6-44f4-ac33-1cc1a620b676): created successfully
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f001ff-3059-4892-a4d2-b84501f1e72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (3d1a2803-373f-45ed-a533-4052e035c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:06:59 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] GroupSnapshot 4701b6cc-6cd1-490b-9dea-66e985176041: creating.
Feb 27 02:06:59 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0032e675-f716-4d63-a5f8-e3f393846da8 tempest-CreateVolumesFromImageTest-1219033328 None] Created volume successfully.
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Group snapshot 4701b6cc-6cd1-490b-9dea-66e985176041: creating. {{(pid=83140) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:06:59 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.530s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:06:59 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Deleted volume successfully.
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-84905b77-6114-4fc1-9e6a-9a2c66f94386 tempest-VolumesActionsTest-1695222663 None] Lock "cinder-8b3b8546-72cb-4f88-9c8b-e2a351f40ada-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:06:59 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81 1073741824" returned: 0 in 0.530s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:06:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:06:59 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81
Feb 27 02:06:59 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:00 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81" returned: 0 in 0.443s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.416s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-812725800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40aa5f22-2409-466b-91db-4e05f8795eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Creating volume 40aa5f22-2409-466b-91db-4e05f8795eab {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:00 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd59b4a-d3bb-4624-adef-efff115783f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c642eac5-d888-409c-9310-1dc7e2a36d81', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce80077a-c1c3-4777-aaaa-6d6082395068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:00 devstack sudo[88175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab 1073741824
Feb 27 02:07:00 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:00 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Volume volume-c642eac5-d888-409c-9310-1dc7e2a36d81 (c642eac5-d888-409c-9310-1dc7e2a36d81): created successfully
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce80077a-c1c3-4777-aaaa-6d6082395068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (68f07d99-49b9-4003-b02f-d04ce203307d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (27914d22-a758-4671-9711-16232d3f8123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311d88c7-316e-40c8-b206-1ea93b9cf8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311d88c7-316e-40c8-b206-1ea93b9cf8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-944361081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9189cb0c-8f13-419b-968d-e5e7d8551072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:00Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de58ea8f-078c-4af0-a461-d3390b8cc77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de58ea8f-078c-4af0-a461-d3390b8cc77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d265896-a5e6-45e4-af5e-2e859e589f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d265896-a5e6-45e4-af5e-2e859e589f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9189cb0c-8f13-419b-968d-e5e7d8551072', 'volume_name': 'volume-9189cb0c-8f13-419b-968d-e5e7d8551072', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c577ea-7f55-4e21-a85b-a311ee91094d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c577ea-7f55-4e21-a85b-a311ee91094d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cf37ba-7b37-4f20-9c43-e8c47871a4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:00 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Volume 9189cb0c-8f13-419b-968d-e5e7d8551072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9189cb0c-8f13-419b-968d-e5e7d8551072', 'volume_size': 1}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:00 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ea4e28d2-9d8b-47bf-a31b-a8686b084f22 tempest-CreateVolumesFromImageTest-1219033328 None] Created volume successfully.
Feb 27 02:07:00 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab 1073741824" returned: 0 in 0.548s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:00 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab
Feb 27 02:07:00 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:01 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab" returned: 0 in 0.444s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.167s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-801716122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e052f3-f670-4c82-9477-0e732486d83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a81da80d30489cb3753e70abe460b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='9042a2bb4b4440f0beaa4500d5f3ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Creating volume 34e052f3-f670-4c82-9477-0e732486d83e {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:01 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce7e922-9347-4e84-ae19-2c4a45287fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40aa5f22-2409-466b-91db-4e05f8795eab', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cdea11-dada-44f8-a88f-518fe4bab2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:01 devstack sudo[88183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e 1073741824
Feb 27 02:07:01 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:01 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Volume volume-40aa5f22-2409-466b-91db-4e05f8795eab (40aa5f22-2409-466b-91db-4e05f8795eab): created successfully
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cdea11-dada-44f8-a88f-518fe4bab2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (1ac71ab0-3a97-4024-8c7c-e91e3bc36f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:01 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-990575e4-f5d0-4ffe-8d87-cdaa5789594d tempest-CreateVolumesFromImageTest-1219033328 None] Created volume successfully.
Feb 27 02:07:01 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e 1073741824" returned: 0 in 0.529s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:01 devstack sudo[88188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e
Feb 27 02:07:01 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:02 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e" returned: 0 in 0.398s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.688s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64a7978-8c72-4121-891e-f944eefa47c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ece535307649fe80f37ebf9b5ffb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='989216151bbb4f6eadcd8e226582fb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Creating volume d64a7978-8c72-4121-891e-f944eefa47c6 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:02 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e10b08-ddd2-4e13-a888-5af26d02899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e052f3-f670-4c82-9477-0e732486d83e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:02 devstack sudo[88191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6 1073741824
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058f7007-f687-4192-960a-9a089d0b3eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:02 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:02 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Volume volume-34e052f3-f670-4c82-9477-0e732486d83e (34e052f3-f670-4c82-9477-0e732486d83e): created successfully
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058f7007-f687-4192-960a-9a089d0b3eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Flow 'volume_create_manager' (07142566-1bd4-4aa4-9450-40ca3a9f73bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:02 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ad7b035b-f8b0-4e78-9269-d2e46355aa4c tempest-CreateVolumesFromImageTest-1219033328 None] Created volume successfully.
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-34e052f3-f670-4c82-9477-0e732486d83e-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-34e052f3-f670-4c82-9477-0e732486d83e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-quobyte-34e052f3-f670-4c82-9477-0e732486d83e" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-34e052f3-f670-4c82-9477-0e732486d83e" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[436e129e-2656-46ce-9fd9-ac3646835856]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:02 devstack sudo[88196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e
Feb 27 02:07:02 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:02 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6 1073741824" returned: 0 in 0.560s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:02 devstack sudo[88198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6
Feb 27 02:07:02 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:03 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e" returned: 0 in 0.510s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:03 devstack sudo[88204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e
Feb 27 02:07:03 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:03 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6" returned: 0 in 0.420s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.941s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88b5d14-776b-4c60-911b-07afb967666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64a7978-8c72-4121-891e-f944eefa47c6', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7723b9f4-22c4-4a71-b8af-7294195461a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Creating offline snapshot 1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 of volume 133c75d5-a474-4720-84ea-c8bd3f4d5ff3 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:07:03 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Volume volume-d64a7978-8c72-4121-891e-f944eefa47c6 (d64a7978-8c72-4121-891e-f944eefa47c6): created successfully
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7723b9f4-22c4-4a71-b8af-7294195461a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Flow 'volume_create_manager' (21ecd794-1cba-4ddd-8e59-8301f9c03eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4cb757-7bdf-4c03-9bec-940590960160]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:03 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-238b3d88-a3e8-47b4-9a0d-7926e1b30537 tempest-CinderUnicodeTest-1902740826 None] Created volume successfully.
Feb 27 02:07:03 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3
Feb 27 02:07:03 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:03 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-34e052f3-f670-4c82-9477-0e732486d83e" returned: 0 in 0.466s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-34e052f3-f670-4c82-9477-0e732486d83e" released by "delete_volume" :: held 1.003s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Created reservations ['da78ba9b-f65b-4f5a-a068-c68bd956cc00', '94c690f3-8270-4ead-bb85-472ad0106bd8', 'e13ea001-97aa-4f09-826f-c7b3bddda640', 'f64a1c90-db4b-4b85-8296-d7a2cbb90564'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:03 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:03 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:03 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" returned: 0 in 0.587s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:03 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 1G
Feb 27 02:07:03 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:04 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.491s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:04 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Deleted volume successfully.
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b3340c00-b976-4c2b-9f0f-c1b73140097e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-34e052f3-f670-4c82-9477-0e732486d83e-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Flow 'volume_create_manager' (bd36c6ff-dd19-449b-bdef-1e5acd688177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364dfd72-e34b-4674-832f-b248e16eafcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364dfd72-e34b-4674-832f-b248e16eafcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-156763892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cae25a6-2cd3-4b83-acc8-8c798074a2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ece535307649fe80f37ebf9b5ffb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:04Z,use_quota=True,user_id='989216151bbb4f6eadcd8e226582fb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e3b3e5-06c8-4022-9700-526565433151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e3b3e5-06c8-4022-9700-526565433151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b50c1a-c987-4f2d-bc75-5b68a656644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b50c1a-c987-4f2d-bc75-5b68a656644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cae25a6-2cd3-4b83-acc8-8c798074a2a3', 'volume_name': 'volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62de3535-bc9d-4942-9747-da5ef2edd88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62de3535-bc9d-4942-9747-da5ef2edd88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a208776b-acd6-4b0c-a8ba-6322858056a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:04 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Volume 9cae25a6-2cd3-4b83-acc8-8c798074a2a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3', 'volume_size': 1}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:04 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 1G" returned: 0 in 0.501s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:04 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789
Feb 27 02:07:04 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-40aa5f22-2409-466b-91db-4e05f8795eab-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-40aa5f22-2409-466b-91db-4e05f8795eab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-quobyte-40aa5f22-2409-466b-91db-4e05f8795eab" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-40aa5f22-2409-466b-91db-4e05f8795eab" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[91528f96-c560-4101-b65b-89e31760c53c]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:04 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789" returned: 0 in 0.458s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:04 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:07:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:04 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789
Feb 27 02:07:04 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:04 devstack sudo[88226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab
Feb 27 02:07:04 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:05 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789" returned: 0 in 0.411s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:05 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab" returned: 0 in 0.488s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:05 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.info
Feb 27 02:07:05 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:05 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab
Feb 27 02:07:05 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:05 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.info" returned: 0 in 0.442s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:05 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:07:05 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-40aa5f22-2409-466b-91db-4e05f8795eab" returned: 0 in 0.433s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-40aa5f22-2409-466b-91db-4e05f8795eab" released by "delete_volume" :: held 0.946s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:05 devstack sudo[88240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.info
Feb 27 02:07:05 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Created reservations ['5581f5d3-433d-4f35-9b52-cd312161d2ea', '41a6a8a5-5694-4dbd-9a47-de073611f024', '1259673f-0f0d-4da2-bec8-b96f16235549', '44513942-b7db-4c14-ad17-eb9a190864ff'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:05 devstack sudo[88242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:05 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-c642eac5-d888-409c-9310-1dc7e2a36d81-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-c642eac5-d888-409c-9310-1dc7e2a36d81-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-quobyte-c642eac5-d888-409c-9310-1dc7e2a36d81" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-c642eac5-d888-409c-9310-1dc7e2a36d81" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a840deb1-08bc-4f41-bfad-8cf7c14a19f9]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:05 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81
Feb 27 02:07:05 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:06 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.info" returned: 0 in 0.448s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.946s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Creating offline snapshot 1fc3b028-6c92-45d7-b991-1308a85637db of volume d1c0078b-7c63-4c37-9acd-3ba5fd840f2c {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[26611ff6-7be8-49bd-a280-bc8f882f19e8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:06 devstack sudo[88247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c
Feb 27 02:07:06 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:06 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.537s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:06 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Deleted volume successfully.
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb4359c5-b874-4314-b1b5-8e44b8f24e82 tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-40aa5f22-2409-466b-91db-4e05f8795eab-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:06 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81" returned: 0 in 0.607s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:06 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81
Feb 27 02:07:06 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:06 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" returned: 0 in 0.516s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:06 devstack sudo[88258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db 1G
Feb 27 02:07:06 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:06 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c642eac5-d888-409c-9310-1dc7e2a36d81" returned: 0 in 0.456s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-c642eac5-d888-409c-9310-1dc7e2a36d81" released by "delete_volume" :: held 1.097s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:06 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Created reservations ['c19b7c49-660e-4ffd-914c-3f7bc7d36b38', '6685385e-ce41-4dcd-8776-d550cb644eb3', '208ed68e-b0bb-4907-94bf-751777df4657', '766dce50-0a36-44fb-836a-e55b575e8191'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:07 devstack sudo[88264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:07 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:07 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db 1G" returned: 0 in 0.515s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:07 devstack sudo[88266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db
Feb 27 02:07:07 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:07 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.459s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Deleted volume successfully.
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d42585d1-4316-4f9a-b99e-fdb401dd56ff tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-c642eac5-d888-409c-9310-1dc7e2a36d81-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:07 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db" returned: 0 in 0.463s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:07 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:07 devstack sudo[88272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db
Feb 27 02:07:07 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-72cd143a-e0d6-44f4-ac33-1cc1a620b676-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-72cd143a-e0d6-44f4-ac33-1cc1a620b676-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-quobyte-72cd143a-e0d6-44f4-ac33-1cc1a620b676" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-72cd143a-e0d6-44f4-ac33-1cc1a620b676" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:08 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db" returned: 0 in 0.435s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce5ab88-b887-4fdb-ba81-27346d8ed90d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:08 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.info
Feb 27 02:07:08 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:08 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676
Feb 27 02:07:08 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:08 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.info" returned: 0 in 0.461s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:08 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:08 devstack sudo[88283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.info
Feb 27 02:07:08 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:08 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676" returned: 0 in 0.536s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:08 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676
Feb 27 02:07:08 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:08 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.info" returned: 0 in 0.458s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.914s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.727s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-156763892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cae25a6-2cd3-4b83-acc8-8c798074a2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ece535307649fe80f37ebf9b5ffb66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:04Z,use_quota=True,user_id='989216151bbb4f6eadcd8e226582fb15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Creating volume 9cae25a6-2cd3-4b83-acc8-8c798074a2a3 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:09 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:09 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-72cd143a-e0d6-44f4-ac33-1cc1a620b676" returned: 0 in 0.455s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:09 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 1073741824
Feb 27 02:07:09 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-72cd143a-e0d6-44f4-ac33-1cc1a620b676" released by "delete_volume" :: held 1.025s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Created reservations ['9c586111-1be2-4ae4-b24f-07ce4ae455ca', '409be319-652e-4048-8156-975372abcdbe', 'caf53db8-01b0-41ec-bda2-16792e7dea29', '2d6387c2-bd8a-4ddc-aba8-684e13410002'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:09 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6c6496d3-24e5-48b3-9639-e17d32cfee5c tempest-GroupSnapshotsTest-76967834 None] group_snapshot 4701b6cc-6cd1-490b-9dea-66e985176041: created successfully
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:09 devstack sudo[88291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:09 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:09 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 1073741824" returned: 0 in 0.603s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:09 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3
Feb 27 02:07:09 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:09 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.550s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:09 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Deleted volume successfully.
Feb 27 02:07:09 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] group_snapshot 4701b6cc-6cd1-490b-9dea-66e985176041: deleting
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] group_snapshot 4701b6cc-6cd1-490b-9dea-66e985176041: deleting {{(pid=83140) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-172fafa7-a100-4e0e-b70d-7109e152331e tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-72cd143a-e0d6-44f4-ac33-1cc1a620b676-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Deleting offline snapshot 1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 of volume 133c75d5-a474-4720-84ea-c8bd3f4d5ff3 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] snapshot_file for this snap is: volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa802f9-f19a-416f-a057-2f849415edd3]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:09 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789
Feb 27 02:07:09 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:10 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" returned: 0 in 0.523s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.979s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-944361081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9189cb0c-8f13-419b-968d-e5e7d8551072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:00Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Creating volume 9189cb0c-8f13-419b-968d-e5e7d8551072 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:10 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a208776b-acd6-4b0c-a8ba-6322858056a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:10 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072 1073741824
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6de5d32-3c78-40f8-b9cd-a234f1cbec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:10 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "cinder-quobyte-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:10 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Volume volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 (9cae25a6-2cd3-4b83-acc8-8c798074a2a3): created successfully
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6de5d32-3c78-40f8-b9cd-a234f1cbec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Flow 'volume_create_manager' (bd36c6ff-dd19-449b-bdef-1e5acd688177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769" acquired by "delete_volume" :: waited 0.029s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:10 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0e758ea3-4d43-42d1-8830-4e6ab3df8c2a tempest-CinderUnicodeTest-1902740826 None] Created volume successfully.
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[017cc7a2-bf21-4612-aecf-7eacebddbf6b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:10 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789" returned: 0 in 0.585s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cad6d8c-dcaa-4ab0-9414-1060f82608e0]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:10 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769
Feb 27 02:07:10 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:10 devstack sudo[88308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3
Feb 27 02:07:10 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:11 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072 1073741824" returned: 0 in 0.770s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:11 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769" returned: 0 in 0.741s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:11 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072
Feb 27 02:07:11 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:11 devstack sudo[88321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769
Feb 27 02:07:11 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:11 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" returned: 0 in 0.679s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:11 devstack sudo[88324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789
Feb 27 02:07:11 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:11 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769" returned: 0 in 0.477s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-quobyte-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769" released by "delete_volume" :: held 1.251s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:11 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789" returned: 0 in 0.494s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Created reservations ['17aca91e-0774-4f38-9d55-740096c66a65', '85940b5b-8441-4038-a1a7-2c514199356c', '92dc1fb6-b5b2-4995-88d8-b6a51faf6a31', '16254197-b4cb-4efd-9ddc-e044184812c1'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:11 devstack sudo[88331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789
Feb 27 02:07:11 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:11 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072" returned: 0 in 0.619s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.887s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cf37ba-7b37-4f20-9c43-e8c47871a4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9189cb0c-8f13-419b-968d-e5e7d8551072', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65503866-1e90-4957-b8de-cda8b22f6448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Creating offline snapshot f711db1f-f909-4f90-84fa-27fe3828d506 of volume 9cae25a6-2cd3-4b83-acc8-8c798074a2a3 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd77ba-eefc-44f8-89e2-083300d25153]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:11 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Volume volume-9189cb0c-8f13-419b-968d-e5e7d8551072 (9189cb0c-8f13-419b-968d-e5e7d8551072): created successfully
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65503866-1e90-4957-b8de-cda8b22f6448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (27914d22-a758-4671-9711-16232d3f8123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:11 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2f760249-089e-4f70-a158-d93ec67d10c0 tempest-VolumesActionsTest-1876194107 None] Created volume successfully.
Feb 27 02:07:11 devstack sudo[88334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:11 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:11 devstack sudo[88333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3
Feb 27 02:07:11 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Acquiring lock "cinder-9189cb0c-8f13-419b-968d-e5e7d8551072-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Lock "cinder-9189cb0c-8f13-419b-968d-e5e7d8551072-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:12 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3.1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789" returned: 0 in 0.457s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Acquiring lock "cinder-quobyte-9189cb0c-8f13-419b-968d-e5e7d8551072" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-1f66cd2b-6b02-4ddd-a6b3-8c42ecafd789" released by "_delete_snapshot" :: held 2.299s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" released by "delete_snapshot" :: held 2.324s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Lock "cinder-quobyte-9189cb0c-8f13-419b-968d-e5e7d8551072" acquired by "delete_volume" :: waited 0.022s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[d582dc1e-588a-4d5e-8bb8-9e18c450341f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-1fc3b028-6c92-45d7-b991-1308a85637db" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-1fc3b028-6c92-45d7-b991-1308a85637db" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Deleting offline snapshot 1fc3b028-6c92-45d7-b991-1308a85637db of volume d1c0078b-7c63-4c37-9acd-3ba5fd840f2c {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] snapshot_file for this snap is: volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c43ed17-1373-4e39-94d9-edf6dbcede6b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:12 devstack sudo[88338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072
Feb 27 02:07:12 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:12 devstack sudo[88339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db
Feb 27 02:07:12 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:12 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.662s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:12 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:12 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Deleted volume successfully.
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" returned: 0 in 0.706s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-beb31ea3-9aaa-4ba0-9f79-cc4de95ded5d tempest-CreateVolumesFromImageTest-1219033328 None] Lock "cinder-0aed4d9f-2af6-4e6c-b8fa-81f46cfa3769-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:12 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 1G
Feb 27 02:07:12 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:12 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072" returned: 0 in 0.565s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:12 devstack sudo[88351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072
Feb 27 02:07:12 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:12 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db" returned: 0 in 0.710s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6272af-2c8e-4c64-b0d5-a0989824db9a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:13 devstack sudo[88359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c
Feb 27 02:07:13 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:13 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 1G" returned: 0 in 0.790s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:13 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506
Feb 27 02:07:13 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:13 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9189cb0c-8f13-419b-968d-e5e7d8551072" returned: 0 in 0.605s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Lock "cinder-quobyte-9189cb0c-8f13-419b-968d-e5e7d8551072" released by "delete_volume" :: held 1.197s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Created reservations ['c10fd948-dbcf-4f6a-94e2-2a15c691fa90', '3e6837e8-d921-43b4-8308-6feb02e5292b', '98c35542-2583-428b-ba51-4a0fbf3b4790', '3ade0585-2f78-4735-9f0a-07c51a52c13f'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:13 devstack sudo[88368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:13 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:13 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" returned: 0 in 0.649s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:13 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db
Feb 27 02:07:13 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:13 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506" returned: 0 in 0.569s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:13 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 is being set with open permissions: ugo+rw
Feb 27 02:07:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:13 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506
Feb 27 02:07:13 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:14 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.583s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:14 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Deleted volume successfully.
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bcf37ce-b252-45fa-9f53-80ca10e6780a tempest-VolumesActionsTest-1695222663 None] Lock "cinder-9189cb0c-8f13-419b-968d-e5e7d8551072-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:14 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db" returned: 0 in 0.528s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:14 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db
Feb 27 02:07:14 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:14 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506" returned: 0 in 0.604s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:14 devstack sudo[88384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.info
Feb 27 02:07:14 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (cfefff5b-ac61-43c0-aff8-0f09ef5c55e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d568fe1-d2a6-42ea-ab4d-db79a4bf9a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c.1fc3b028-6c92-45d7-b991-1308a85637db" returned: 0 in 0.626s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d568fe1-d2a6-42ea-ab4d-db79a4bf9a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766118172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd15200-0db1-4112-aa5b-fad42b1da08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:15Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54042b9-231c-4915-a9ae-c4a29303cb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54042b9-231c-4915-a9ae-c4a29303cb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8298c849-0a91-4edd-87d0-ee006becbb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8298c849-0a91-4edd-87d0-ee006becbb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd15200-0db1-4112-aa5b-fad42b1da08a', 'volume_name': 'volume-3fd15200-0db1-4112-aa5b-fad42b1da08a', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7340bbba-f452-4372-b5f7-a4fc6529b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7340bbba-f452-4372-b5f7-a4fc6529b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45645c71-0ded-405d-a9cb-7ebb6ac75f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Volume 3fd15200-0db1-4112-aa5b-fad42b1da08a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd15200-0db1-4112-aa5b-fad42b1da08a', 'volume_size': 1}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-1fc3b028-6c92-45d7-b991-1308a85637db" released by "_delete_snapshot" :: held 2.632s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (97996b0f-282c-4870-9d0a-25f1cd4943ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca01697f-5a49-4d01-888f-c08f1f66a73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" released by "delete_snapshot" :: held 2.681s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca01697f-5a49-4d01-888f-c08f1f66a73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373731780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfdad2c-f7c4-4083-b342-6227c202f3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:15Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0d9bc1-3ce7-4ccb-952b-fb21d3fa5c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0d9bc1-3ce7-4ccb-952b-fb21d3fa5c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6eb4ae-c2af-4286-9661-9e330989f1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6eb4ae-c2af-4286-9661-9e330989f1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dfdad2c-f7c4-4083-b342-6227c202f3df', 'volume_name': 'volume-1dfdad2c-f7c4-4083-b342-6227c202f3df', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f649b24-8add-4870-acc0-16a9fb24cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f649b24-8add-4870-acc0-16a9fb24cc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96631270-a689-4623-b70c-2171072bcf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:14 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume 1dfdad2c-f7c4-4083-b342-6227c202f3df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dfdad2c-f7c4-4083-b342-6227c202f3df', 'volume_size': 1}
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:14 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.info" returned: 0 in 0.513s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:14 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.info is being set with open permissions: ugo+rw
Feb 27 02:07:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:14 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.info
Feb 27 02:07:14 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:14 devstack cinder-volume[83140]: WARNING cinder.quota [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1441272526 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1441272526, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:07:14 devstack cinder-volume[83140]: WARNING cinder.quota [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1441272526 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1441272526, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['914aec4c-3428-4246-85d4-3de3d5eea6a2', '4685141b-ed39-4654-b988-aecf07f75455', 'eb954fb5-37f4-4a14-b7b8-4a7fb7dee118', '7a2da582-1a5d-49eb-ae98-f414b9683a9c'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['f4b701c0-267d-4c51-9948-349a0376d543', '00537c2d-3676-4ae3-b55d-8a7b947c7c8f', '7f0a95e4-88cb-4587-94cb-29d46742cba1', '358b7117-e676-44c2-a796-23011678dbbd'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:15 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-fc33cf00-af43-4b19-9700-e54c619b8796 tempest-GroupSnapshotsTest-76967834 None] group_snapshot 4701b6cc-6cd1-490b-9dea-66e985176041: deleted successfully
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b57d44-9b2d-44bb-9eaa-5b58204e4959]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:15 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.info" returned: 0 in 0.525s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.813s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.703s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766118172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd15200-0db1-4112-aa5b-fad42b1da08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:15Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Creating volume 3fd15200-0db1-4112-aa5b-fad42b1da08a {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:15 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:15 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a 1073741824
Feb 27 02:07:15 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:15 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-c702ad40-2363-4245-919e-f53896a12a4f tempest-CinderUnicodeTest-1902740826 None] Create snapshot completed successfully
Feb 27 02:07:15 devstack sudo[88391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3
Feb 27 02:07:15 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:16 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" returned: 0 in 0.568s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "cinder-f711db1f-f909-4f90-84fa-27fe3828d506-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:16 devstack sudo[88401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3
Feb 27 02:07:16 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-f711db1f-f909-4f90-84fa-27fe3828d506-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "cinder-quobyte-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-quobyte-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "cinder-quobyte-f711db1f-f909-4f90-84fa-27fe3828d506" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-quobyte-f711db1f-f909-4f90-84fa-27fe3828d506" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Deleting offline snapshot f711db1f-f909-4f90-84fa-27fe3828d506 of volume 9cae25a6-2cd3-4b83-acc8-8c798074a2a3 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] snapshot_file for this snap is: volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[089e89cc-8ebe-4b2e-b575-f23a2e18fb83]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:16 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a 1073741824" returned: 0 in 0.620s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:16 devstack sudo[88404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a
Feb 27 02:07:16 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:16 devstack sudo[88403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506
Feb 27 02:07:16 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:16 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" returned: 0 in 0.535s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-133c75d5-a474-4720-84ea-c8bd3f4d5ff3" released by "delete_volume" :: held 1.152s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[308cfa44-8b0a-41a9-a2dd-8d8d09ada7df]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:16 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a" returned: 0 in 0.471s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.743s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-373731780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfdad2c-f7c4-4083-b342-6227c202f3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:15Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Creating volume 1dfdad2c-f7c4-4083-b342-6227c202f3df {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:16 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45645c71-0ded-405d-a9cb-7ebb6ac75f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd15200-0db1-4112-aa5b-fad42b1da08a', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:16 devstack sudo[88412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c
Feb 27 02:07:16 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f66e054-1233-40b0-840e-a4755ecb3eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:16 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Volume volume-3fd15200-0db1-4112-aa5b-fad42b1da08a (3fd15200-0db1-4112-aa5b-fad42b1da08a): created successfully
Feb 27 02:07:16 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df 1073741824
Feb 27 02:07:16 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:16 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f66e054-1233-40b0-840e-a4755ecb3eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (cfefff5b-ac61-43c0-aff8-0f09ef5c55e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506" returned: 0 in 0.626s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:07:16 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9b715115-5f36-4796-ae00-f391d3c1e346 tempest-VolumesActionsTest-1876194107 None] Created volume successfully.
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e7c9c7-3eff-4a61-a27e-e8edf2724ffd]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:16 devstack sudo[88416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3
Feb 27 02:07:16 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:17 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" returned: 0 in 0.587s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:17 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c
Feb 27 02:07:17 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:17 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" returned: 0 in 0.551s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:17 devstack sudo[88429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506
Feb 27 02:07:17 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:17 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df 1073741824" returned: 0 in 0.655s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:17 devstack sudo[88431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df
Feb 27 02:07:17 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:17 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" returned: 0 in 0.489s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-d1c0078b-7c63-4c37-9acd-3ba5fd840f2c" released by "delete_volume" :: held 1.109s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['132b5542-11c3-4bf2-9047-e66c32f8c28d'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:17 devstack cinder-volume[83140]: WARNING cinder.quota [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1441272526 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1441272526, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['39c7ce2d-195e-437e-a122-8ccdc9325e21', '235ef366-cc0f-4abf-9f73-d079f9134681', '2f99ac95-eeaf-4a83-b152-c7316903170e', '643f803c-9571-431c-a06f-7b41822bd8a8'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:17 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506" returned: 0 in 0.579s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:17 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df" returned: 0 in 0.537s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:17 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506
Feb 27 02:07:17 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96631270-a689-4623-b70c-2171072bcf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dfdad2c-f7c4-4083-b342-6227c202f3df', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c63c37-194b-4702-bd1b-2132a4d9f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Created reservations ['5b08cc8c-d1fa-4863-a03c-4e5fcc2fdfda', '651c3d6b-8ed2-4fc5-8765-80637ae45e8f', 'b2941396-cf91-45b8-ac4d-314c478c41cb', 'be7ca7a5-3097-4971-94c0-9f3a4a4f3b06'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:17 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume volume-1dfdad2c-f7c4-4083-b342-6227c202f3df (1dfdad2c-f7c4-4083-b342-6227c202f3df): created successfully
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c63c37-194b-4702-bd1b-2132a4d9f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (97996b0f-282c-4870-9d0a-25f1cd4943ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Acquiring lock "cinder-3fd15200-0db1-4112-aa5b-fad42b1da08a-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:18 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-5059326d-9845-4524-af9a-760bc7a7cf7d tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created volume successfully.
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Lock "cinder-3fd15200-0db1-4112-aa5b-fad42b1da08a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Acquiring lock "cinder-quobyte-3fd15200-0db1-4112-aa5b-fad42b1da08a" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Lock "cinder-quobyte-3fd15200-0db1-4112-aa5b-fad42b1da08a" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb768ae-c552-4a4f-8ed3-23def7f06021]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:18 devstack sudo[88441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:18 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:18 devstack sudo[88440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a
Feb 27 02:07:18 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:18 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3.f711db1f-f909-4f90-84fa-27fe3828d506" returned: 0 in 0.472s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-quobyte-f711db1f-f909-4f90-84fa-27fe3828d506" released by "_delete_snapshot" :: held 2.299s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-quobyte-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" released by "delete_snapshot" :: held 2.315s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Created reservations ['e431b8e1-1881-44ac-a2bc-0f34350269cb', 'b2b9c49c-5fe3-4977-bc0d-17506cc9fa9d', '51601c23-e65a-4d4d-a903-4f85fc4e2aa2', 'e7f95e29-b66e-45e6-8a02-16b37b608753'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:18 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Delete snapshot completed successfully.
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-a5991aeb-4d6a-44cb-9d4b-3b318721a144 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-f711db1f-f909-4f90-84fa-27fe3828d506-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:18 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.463s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:18 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-aa0dcbef-54b7-4f57-9083-b186c2edf405 tempest-GroupSnapshotsTest-76967834 None] Delete group completed successfully.
Feb 27 02:07:18 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a" returned: 0 in 0.523s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:18 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a
Feb 27 02:07:18 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-59529652-116f-4d5e-a53e-4db9a5515277 tempest-GroupSnapshotsTest-76967834 None] Group tempest-GroupSnapshotsTest-Group-2093594407: creating
Feb 27 02:07:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-59529652-116f-4d5e-a53e-4db9a5515277 tempest-GroupSnapshotsTest-76967834 None] Group tempest-GroupSnapshotsTest-Group-2093594407: created successfully
Feb 27 02:07:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-59529652-116f-4d5e-a53e-4db9a5515277 tempest-GroupSnapshotsTest-76967834 None] Create group completed successfully.
Feb 27 02:07:19 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3fd15200-0db1-4112-aa5b-fad42b1da08a" returned: 0 in 0.508s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Lock "cinder-quobyte-3fd15200-0db1-4112-aa5b-fad42b1da08a" released by "delete_volume" :: held 1.058s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Created reservations ['0ea40f48-da0f-4a29-ade2-89ea6ef50cee', '04274a1a-01a3-4e2a-b874-c1b99cd8fae1', '83f2c5ad-2fc1-42e5-9657-c1f34d08f356', '5e0ac5b8-29bb-48fe-9d45-f4084a461127'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "cinder-9cae25a6-2cd3-4b83-acc8-8c798074a2a3-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-9cae25a6-2cd3-4b83-acc8-8c798074a2a3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:19 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:19 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "cinder-quobyte-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (6a9f9989-dc41-4c54-9d9a-cfa5dcf9d639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7ad5cc-0bd0-459e-9c8f-49f3a33877ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7ad5cc-0bd0-459e-9c8f-49f3a33877ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795279155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146221e3-f722-42b2-a6b7-6ff11cc3bf63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:19Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0b0102-da52-4527-8dc3-887954d671ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0b0102-da52-4527-8dc3-887954d671ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63f7b49-03c2-4d20-af39-fdd5241e0d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63f7b49-03c2-4d20-af39-fdd5241e0d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146221e3-f722-42b2-a6b7-6ff11cc3bf63', 'volume_name': 'volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7187ddc-7c12-4734-b275-c0844e69c275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7187ddc-7c12-4734-b275-c0844e69c275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d56b369-db78-4617-adc6-b8b5a2bd40bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume 146221e3-f722-42b2-a6b7-6ff11cc3bf63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63', 'volume_size': 1}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795279155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146221e3-f722-42b2-a6b7-6ff11cc3bf63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:19Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Creating volume 146221e3-f722-42b2-a6b7-6ff11cc3bf63 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:19 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-quobyte-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" acquired by "delete_volume" :: waited 0.115s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:19 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63 1073741824
Feb 27 02:07:19 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d00380c-5020-4e1a-8ca6-6bd2658dcdb0]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (aa0615d6-80c3-4731-bc19-dd75814f8e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:19 devstack sudo[88456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3
Feb 27 02:07:19 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c8fe84-b1f1-4ec4-8152-aba63c68907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c8fe84-b1f1-4ec4-8152-aba63c68907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-267246576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38ee5d5-7335-4948-a4a3-e6e02673f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38ee5d5-7335-4948-a4a3-e6e02673f55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3959db27-126c-4d95-a68a-57f2d442da0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3959db27-126c-4d95-a68a-57f2d442da0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4', 'volume_name': 'volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc989f6-a1f4-4f68-bbae-9760439fdad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc989f6-a1f4-4f68-bbae-9760439fdad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd1d514-6281-4138-81eb-362d9853eae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume 9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4', 'volume_size': 1}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:19 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.512s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Deleted volume successfully.
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ee895431-97d9-4089-a964-babad72b263f tempest-VolumesActionsTest-1695222663 None] Lock "cinder-3fd15200-0db1-4112-aa5b-fad42b1da08a-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (d1aa3750-2cd1-4602-afc3-aa88d6d78396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e7fa55-334b-474d-a93d-d71a2b09a097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e7fa55-334b-474d-a93d-d71a2b09a097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361355601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfe0fa9-5d6d-478b-811e-dbff814e7f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfe0fa9-5d6d-478b-811e-dbff814e7f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3a515a-c36d-4e6c-bf7b-9487b4cfa21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3a515a-c36d-4e6c-bf7b-9487b4cfa21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d', 'volume_name': 'volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f715b9-7e46-43bd-ac34-ef11ae8e0106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f715b9-7e46-43bd-ac34-ef11ae8e0106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834de4b0-b17a-40b5-869b-c9b80abd89de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d', 'volume_size': 1}
Feb 27 02:07:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:20 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" returned: 0 in 0.586s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:20 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63 1073741824" returned: 0 in 0.651s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:20 devstack sudo[88465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3
Feb 27 02:07:20 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:20 devstack sudo[88467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63
Feb 27 02:07:20 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (f04f6fc3-33c2-419f-ba88-4d4fbf45a8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559c6027-8bd8-4ea3-8cf4-9e5606c88bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559c6027-8bd8-4ea3-8cf4-9e5606c88bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716577467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8ff73f-7174-489b-b4d7-3dffb62797e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9a0ae4-177f-4afd-8607-f4a503a511ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9a0ae4-177f-4afd-8607-f4a503a511ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad31827-358f-4eb4-8dc5-3a44e3d7f96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad31827-358f-4eb4-8dc5-3a44e3d7f96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8ff73f-7174-489b-b4d7-3dffb62797e8', 'volume_name': 'volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc27460-69cd-4616-b473-b7246d81c25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc27460-69cd-4616-b473-b7246d81c25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8075e795-06d7-42a8-bc7d-1734f0371e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume ef8ff73f-7174-489b-b4d7-3dffb62797e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8', 'volume_size': 1}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (4f2ad011-d28c-4c94-8d7b-ea715f6b8dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be95793d-ebfb-4da7-b2c8-db69caf1d751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be95793d-ebfb-4da7-b2c8-db69caf1d751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1827308878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76fd64a-4541-44b9-ac72-5049b139a9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ce28b6-5f7e-47dc-a80e-4052aad9ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ce28b6-5f7e-47dc-a80e-4052aad9ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39a7195-9db0-412d-bdd6-8caeb3bb86ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39a7195-9db0-412d-bdd6-8caeb3bb86ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76fd64a-4541-44b9-ac72-5049b139a9ed', 'volume_name': 'volume-b76fd64a-4541-44b9-ac72-5049b139a9ed', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007ebc08-0a88-458e-89b7-890b9e484ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007ebc08-0a88-458e-89b7-890b9e484ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddc88d2-245c-4de1-a515-4f3e1ce0e955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume b76fd64a-4541-44b9-ac72-5049b139a9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76fd64a-4541-44b9-ac72-5049b139a9ed', 'volume_size': 1}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Flow 'volume_create_manager' (d7c9f9b0-e3c4-4f9c-87e8-430cb2eade2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f076f6da-adfd-4de1-861b-36dbd58fcf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f076f6da-adfd-4de1-861b-36dbd58fcf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-369859852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a10b1761-6dfa-442b-8943-0c9666e403e3,host='devstack@QuobyteHD#QuobyteHD',id=4652f093-9b33-4be5-b085-a67ca7b0e1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9425def193be4b788fb7fcee43d02a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:21Z,use_quota=True,user_id='99af59ded704483181a4ee37662ebe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73db02f-38ff-44ac-be40-3cef59ba0898),volume_type_id=f73db02f-38ff-44ac-be40-3cef59ba0898)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6594a0-a16e-427c-b0dd-e08f79700e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6594a0-a16e-427c-b0dd-e08f79700e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b349d3fd-be83-4719-9a98-fe3c826e5c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b349d3fd-be83-4719-9a98-fe3c826e5c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4652f093-9b33-4be5-b085-a67ca7b0e1c5', 'volume_name': 'volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7274034f-7223-430f-8177-a7ffa4f35c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7274034f-7223-430f-8177-a7ffa4f35c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1d5b8b-31a0-4db0-9619-9e1d4822c00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Volume 4652f093-9b33-4be5-b085-a67ca7b0e1c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5', 'volume_size': 1}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" returned: 0 in 0.646s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63" returned: 0 in 0.618s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-267246576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Creating volume 9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:20 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-quobyte-9cae25a6-2cd3-4b83-acc8-8c798074a2a3" released by "delete_volume" :: held 1.319s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:20 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4 1073741824
Feb 27 02:07:20 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d56b369-db78-4617-adc6-b8b5a2bd40bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d336e6-fa0a-499f-9efe-056ca6872f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63 (146221e3-f722-42b2-a6b7-6ff11cc3bf63): created successfully
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d336e6-fa0a-499f-9efe-056ca6872f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (6a9f9989-dc41-4c54-9d9a-cfa5dcf9d639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (b7d00018-5471-4bb3-939a-a837d9b9b554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764de1a0-8f87-4be9-b872-27e08477b0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-512510f3-1e1d-4ab7-a385-ac0b762a5bee tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created volume successfully.
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764de1a0-8f87-4be9-b872-27e08477b0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-537781586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b89a29-6229-4ca5-8858-926587ebf1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:21Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5084415-f74e-40f8-b99e-2e8c7c5e6a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5084415-f74e-40f8-b99e-2e8c7c5e6a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522a469b-3855-4209-a33c-e16e54f9136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522a469b-3855-4209-a33c-e16e54f9136e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b89a29-6229-4ca5-8858-926587ebf1f3', 'volume_name': 'volume-99b89a29-6229-4ca5-8858-926587ebf1f3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c195f53-1953-4ae7-9ea7-a198dda80dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c195f53-1953-4ae7-9ea7-a198dda80dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c65ce4-7e37-492b-b32e-a0c223c2f3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:20 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Volume 99b89a29-6229-4ca5-8858-926587ebf1f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b89a29-6229-4ca5-8858-926587ebf1f3', 'volume_size': 1}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Created reservations ['261b02ce-396a-4be5-8b50-3affd5471521', '22607be9-8009-441b-aadd-ad69d745960c', '6cb5ac1e-a742-49e7-af1c-689152b20937', '3ac0298f-5d1c-4119-95cf-56b2ad8adad0'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:20 devstack sudo[88473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:20 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:21 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4 1073741824" returned: 0 in 0.497s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:21 devstack sudo[88478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4
Feb 27 02:07:21 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:21 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.423s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:21 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Deleted volume successfully.
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ef8d0c8f-e528-49e5-b21a-c78d8a5058a7 tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-9cae25a6-2cd3-4b83-acc8-8c798074a2a3-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "cinder-d64a7978-8c72-4121-891e-f944eefa47c6-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-d64a7978-8c72-4121-891e-f944eefa47c6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "cinder-quobyte-d64a7978-8c72-4121-891e-f944eefa47c6" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-quobyte-d64a7978-8c72-4121-891e-f944eefa47c6" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151570d-a32b-4e82-bd26-aa37004b66d4]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:21 devstack sudo[88481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6
Feb 27 02:07:21 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:21 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4" returned: 0 in 0.459s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361355601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Creating volume e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:21 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd1d514-6281-4138-81eb-362d9853eae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:21 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d 1073741824
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8177b2d7-3927-46a7-93bd-bf48e470b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:21 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:INSERT=69,cinder:UPDATE=292,cinder:SELECT=239,cinder:DELETE=18 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:07:21 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4 (9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4): created successfully
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8177b2d7-3927-46a7-93bd-bf48e470b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (aa0615d6-80c3-4731-bc19-dd75814f8e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:21 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-091f3d1d-d6e7-4c67-972a-c644dc38f05b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created volume successfully.
Feb 27 02:07:22 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6" returned: 0 in 0.504s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:22 devstack sudo[88489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6
Feb 27 02:07:22 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:22 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d 1073741824" returned: 0 in 0.580s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:22 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d
Feb 27 02:07:22 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:22 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d64a7978-8c72-4121-891e-f944eefa47c6" returned: 0 in 0.476s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-quobyte-d64a7978-8c72-4121-891e-f944eefa47c6" released by "delete_volume" :: held 1.006s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Created reservations ['2d50add7-6c50-46e9-af81-b07a8662b840', '2efb8f30-35b8-418f-9905-eca23a9f6e87', '8ac3b9a5-2463-4d18-977b-981d5e7d8d13', '262b2ac0-5317-4c5e-8568-13ce776822ed'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:22 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:22 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:22 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d" returned: 0 in 0.483s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.558s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716577467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8ff73f-7174-489b-b4d7-3dffb62797e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Creating volume ef8ff73f-7174-489b-b4d7-3dffb62797e8 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:22 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:22 devstack sudo[88501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8 1073741824
Feb 27 02:07:22 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834de4b0-b17a-40b5-869b-c9b80abd89de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051a05d2-7339-4b23-b01c-fc4482d00d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:22 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d (e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d): created successfully
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051a05d2-7339-4b23-b01c-fc4482d00d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:22 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (d1aa3750-2cd1-4602-afc3-aa88d6d78396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:22 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bd7b7391-0590-42de-ae7e-d54b030656bd tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created volume successfully.
Feb 27 02:07:23 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.482s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:23 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Deleted volume successfully.
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-52a7e649-8ae4-41e1-95dc-7764802fbd4c tempest-CinderUnicodeTest-1902740826 None] Lock "cinder-d64a7978-8c72-4121-891e-f944eefa47c6-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:23 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8 1073741824" returned: 0 in 0.510s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:23 devstack sudo[88507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8
Feb 27 02:07:23 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:23 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8" returned: 0 in 0.491s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.239s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1827308878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76fd64a-4541-44b9-ac72-5049b139a9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6cfebbd5a6407ab1c15302f9d50003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='c5baeda92fe14cba9b1f9a0e568af02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Creating volume b76fd64a-4541-44b9-ac72-5049b139a9ed {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:23 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8075e795-06d7-42a8-bc7d-1734f0371e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258cfb18-3940-4375-be80-a5c8bcba5ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:23 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed 1073741824
Feb 27 02:07:23 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:23 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8 (ef8ff73f-7174-489b-b4d7-3dffb62797e8): created successfully
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258cfb18-3940-4375-be80-a5c8bcba5ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (f04f6fc3-33c2-419f-ba88-4d4fbf45a8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:23 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3aad76db-2272-46ca-82fc-00d1329ac21b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created volume successfully.
Feb 27 02:07:24 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed 1073741824" returned: 0 in 0.611s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:24 devstack sudo[88515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed
Feb 27 02:07:24 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:25 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed" returned: 0 in 0.570s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.372s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a10b1761-6dfa-442b-8943-0c9666e403e3,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-369859852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a10b1761-6dfa-442b-8943-0c9666e403e3,host='devstack@QuobyteHD#QuobyteHD',id=4652f093-9b33-4be5-b085-a67ca7b0e1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9425def193be4b788fb7fcee43d02a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:21Z,use_quota=True,user_id='99af59ded704483181a4ee37662ebe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73db02f-38ff-44ac-be40-3cef59ba0898),volume_type_id=f73db02f-38ff-44ac-be40-3cef59ba0898)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Creating volume 4652f093-9b33-4be5-b085-a67ca7b0e1c5 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:25 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddc88d2-245c-4de1-a515-4f3e1ce0e955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76fd64a-4541-44b9-ac72-5049b139a9ed', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:25 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 1073741824
Feb 27 02:07:25 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a4e92b-1070-4e4d-8455-91efa136e12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:25 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Volume volume-b76fd64a-4541-44b9-ac72-5049b139a9ed (b76fd64a-4541-44b9-ac72-5049b139a9ed): created successfully
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a4e92b-1070-4e4d-8455-91efa136e12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Flow 'volume_create_manager' (4f2ad011-d28c-4c94-8d7b-ea715f6b8dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:25 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2358abb5-63ec-4c0a-a976-c99ef2fb2e48 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created volume successfully.
Feb 27 02:07:25 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 1073741824" returned: 0 in 0.622s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:25 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5
Feb 27 02:07:25 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-b76fd64a-4541-44b9-ac72-5049b139a9ed-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-b76fd64a-4541-44b9-ac72-5049b139a9ed-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-quobyte-b76fd64a-4541-44b9-ac72-5049b139a9ed" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-b76fd64a-4541-44b9-ac72-5049b139a9ed" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e591b4-cba3-492c-83e2-c17d9d513d0a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:26 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5" returned: 0 in 0.483s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:26 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed
Feb 27 02:07:26 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.344s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-537781586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b89a29-6229-4ca5-8858-926587ebf1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:21Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Creating volume 99b89a29-6229-4ca5-8858-926587ebf1f3 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:26 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1d5b8b-31a0-4db0-9619-9e1d4822c00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232414a0-36a2-4821-8afd-1da3bcd013c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:26 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3 1073741824
Feb 27 02:07:26 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:26 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Volume volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 (4652f093-9b33-4be5-b085-a67ca7b0e1c5): created successfully
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232414a0-36a2-4821-8afd-1da3bcd013c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Flow 'volume_create_manager' (d7c9f9b0-e3c4-4f9c-87e8-430cb2eade2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:26 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1e5a1d58-497c-4b95-b34a-487bc8c8e26a tempest-GroupSnapshotsTest-76967834 None] Created volume successfully.
Feb 27 02:07:26 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed" returned: 0 in 0.590s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:26 devstack sudo[88536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed
Feb 27 02:07:26 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:26 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3 1073741824" returned: 0 in 0.565s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:26 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3
Feb 27 02:07:26 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:27 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] GroupSnapshot 8d256e29-fd2a-49f5-91ec-b2510175d219: creating.
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Group snapshot 8d256e29-fd2a-49f5-91ec-b2510175d219: creating. {{(pid=83140) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:27 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b76fd64a-4541-44b9-ac72-5049b139a9ed" returned: 0 in 0.567s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-b76fd64a-4541-44b9-ac72-5049b139a9ed" released by "delete_volume" :: held 1.180s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created reservations ['a2a0ffec-f67f-44a4-bdd1-d07c10860c4f', '4004d8da-859e-4c01-bd06-324f14189fa5', 'c374bad5-31a2-435d-a6d8-3438c5aa1026', '59093a19-aa90-4e02-99f6-47beb51534dd'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:27 devstack sudo[88542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:27 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:27 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3" returned: 0 in 0.700s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.243s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c65ce4-7e37-492b-b32e-a0c223c2f3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b89a29-6229-4ca5-8858-926587ebf1f3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21718e96-6f65-4fa3-99e8-7104106579dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Creating offline snapshot 68124db1-12f8-485c-adcb-164263c19076 of volume 4652f093-9b33-4be5-b085-a67ca7b0e1c5 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:07:27 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Volume volume-99b89a29-6229-4ca5-8858-926587ebf1f3 (99b89a29-6229-4ca5-8858-926587ebf1f3): created successfully
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21718e96-6f65-4fa3-99e8-7104106579dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (b7d00018-5471-4bb3-939a-a837d9b9b554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3738861-89fd-4cc1-a5f7-1b64b19eecb4]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:27 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ecd31390-fba6-4829-9530-6f3c8822983a tempest-VolumesActionsTest-1876194107 None] Created volume successfully.
Feb 27 02:07:27 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5
Feb 27 02:07:27 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:27 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.517s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:27 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Deleted volume successfully.
Feb 27 02:07:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9bfb3c85-d11e-4254-a5b7-3a564f1dcab0 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-b76fd64a-4541-44b9-ac72-5049b139a9ed-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:28 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5" returned: 0 in 0.588s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:28 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 1G
Feb 27 02:07:28 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-ef8ff73f-7174-489b-b4d7-3dffb62797e8-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-ef8ff73f-7174-489b-b4d7-3dffb62797e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-quobyte-ef8ff73f-7174-489b-b4d7-3dffb62797e8" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-ef8ff73f-7174-489b-b4d7-3dffb62797e8" acquired by "delete_volume" :: waited 0.026s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1109da6e-a357-43ef-864c-11ef0d8b031c]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Acquiring lock "cinder-99b89a29-6229-4ca5-8858-926587ebf1f3-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Lock "cinder-99b89a29-6229-4ca5-8858-926587ebf1f3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:28 devstack sudo[88552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8
Feb 27 02:07:28 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Acquiring lock "cinder-quobyte-99b89a29-6229-4ca5-8858-926587ebf1f3" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Lock "cinder-quobyte-99b89a29-6229-4ca5-8858-926587ebf1f3" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a9af7-7e59-432a-89e5-de5e8c7033d6]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:28 devstack sudo[88554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3
Feb 27 02:07:28 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:28 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 1G" returned: 0 in 0.810s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:29 devstack sudo[88559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076
Feb 27 02:07:29 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:29 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8" returned: 0 in 0.715s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:29 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8
Feb 27 02:07:29 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:29 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3" returned: 0 in 0.664s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:29 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3
Feb 27 02:07:29 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:29 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076" returned: 0 in 0.578s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:29 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:29 devstack sudo[88574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076
Feb 27 02:07:29 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:29 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ef8ff73f-7174-489b-b4d7-3dffb62797e8" returned: 0 in 0.663s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-ef8ff73f-7174-489b-b4d7-3dffb62797e8" released by "delete_volume" :: held 1.411s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=245,cinder:UPDATE=291,cinder:DELETE=25,cinder:INSERT=67 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created reservations ['a3ad73e3-3ded-4027-a3c3-43d018335b12', '19a6244e-02e9-47dd-b4be-0cdcaa362773', 'c99e6af7-d0d6-4726-b0e1-cdbc487ee193', '012006ea-a047-4be7-8a4c-29e9c0327687'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:30 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:30 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:30 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99b89a29-6229-4ca5-8858-926587ebf1f3" returned: 0 in 0.760s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Lock "cinder-quobyte-99b89a29-6229-4ca5-8858-926587ebf1f3" released by "delete_volume" :: held 1.454s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Created reservations ['67c550bb-eb87-4ba1-b521-648b21de373f', '8224212f-7bac-47d0-aed3-f4bd90fe7b48', 'ad597e41-b898-45f2-9957-0fd9c804edad', '5f01c6cd-2e4e-4d7f-9899-97681dbfbe05'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:30 devstack sudo[88581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:30 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:30 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076" returned: 0 in 0.681s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:30 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.info
Feb 27 02:07:30 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-quobyte-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[807ecf67-0e70-4b5f-9604-118040ae7d64]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:30 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.781s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:30 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Deleted volume successfully.
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-1ef9d708-53e2-4535-a123-3ca177c955b5 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-ef8ff73f-7174-489b-b4d7-3dffb62797e8-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:30 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.722s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:30 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Deleted volume successfully.
Feb 27 02:07:30 devstack sudo[88588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d
Feb 27 02:07:30 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ad0cbf34-981e-4116-a287-fbc5359ad890 tempest-VolumesActionsTest-1695222663 None] Lock "cinder-99b89a29-6229-4ca5-8858-926587ebf1f3-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:31 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.info" returned: 0 in 1.080s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:31 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:31 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.info
Feb 27 02:07:31 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (8b663036-8b20-431b-ae42-f25912b8bfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9c05e9-3b27-4da0-95f6-9e20ed92276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9c05e9-3b27-4da0-95f6-9e20ed92276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2118531361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9561664-424b-451f-b228-46b810f8921d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:31Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c7126c-12d8-4aaf-8105-e975f82a74a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c7126c-12d8-4aaf-8105-e975f82a74a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbb45a4-785e-485a-abf3-7d322eaf87d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbb45a4-785e-485a-abf3-7d322eaf87d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9561664-424b-451f-b228-46b810f8921d', 'volume_name': 'volume-e9561664-424b-451f-b228-46b810f8921d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95401fe5-5b87-47bd-8fe3-c04dd83e3948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:31 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95401fe5-5b87-47bd-8fe3-c04dd83e3948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cc13e2-99b2-4310-b24b-d8408bc86faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:31 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Volume e9561664-424b-451f-b228-46b810f8921d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9561664-424b-451f-b228-46b810f8921d', 'volume_size': 1}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d" returned: 0 in 0.828s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:31 devstack sudo[88596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d
Feb 27 02:07:31 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:32 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.info" returned: 0 in 0.707s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.532s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2118531361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9561664-424b-451f-b228-46b810f8921d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3278160b054d56958df200d23fe5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:31Z,use_quota=True,user_id='4e9b7c031ae8498f83d200f2be197f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Creating volume e9561664-424b-451f-b228-46b810f8921d {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:32 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:32 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d 1073741824
Feb 27 02:07:32 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:32 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d" returned: 0 in 0.582s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d" released by "delete_volume" :: held 1.449s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:32 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-cbcedfaa-4a03-40c3-9d0c-401ee0f1f522 tempest-GroupSnapshotsTest-76967834 None] group_snapshot 8d256e29-fd2a-49f5-91ec-b2510175d219: created successfully
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created reservations ['02b6374d-41d2-440a-abf9-f2174d857ef6', '48080422-91c9-471d-ae2d-974113a2bc63', 'e6812d98-6596-4947-a424-3b59e93e5490', 'f14d2371-47dd-4832-a7ff-78c4d9bfd1bf'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:32 devstack sudo[88602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:32 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:32 devstack sudo[88604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:32 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:32 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] group_snapshot 8d256e29-fd2a-49f5-91ec-b2510175d219: deleting
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] group_snapshot 8d256e29-fd2a-49f5-91ec-b2510175d219: deleting {{(pid=83140) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-4652f093-9b33-4be5-b085-a67ca7b0e1c5" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-4652f093-9b33-4be5-b085-a67ca7b0e1c5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-68124db1-12f8-485c-adcb-164263c19076" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-68124db1-12f8-485c-adcb-164263c19076" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Deleting offline snapshot 68124db1-12f8-485c-adcb-164263c19076 of volume 4652f093-9b33-4be5-b085-a67ca7b0e1c5 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] snapshot_file for this snap is: volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1454a94-c586-4b0f-8ccf-9cb3042c4ff3]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:32 devstack sudo[88610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076
Feb 27 02:07:32 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-quobyte-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[933e37e5-2c73-43aa-a4b3-0852e6df1537]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:33 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d 1073741824" returned: 0 in 1.028s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:33 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4
Feb 27 02:07:33 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:33 devstack sudo[88614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d
Feb 27 02:07:33 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:33 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 1.100s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:33 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Deleted volume successfully.
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-702b8ccc-fa6c-4a0d-86c5-c0e80d1bce7c tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-e0f6d3f7-5b4f-4bcf-ad2e-012966a32c2d-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:33 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.970s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:33 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076" returned: 0 in 0.950s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46344d7-7b23-475d-b60b-1af568799c25]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:33 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:33 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5
Feb 27 02:07:33 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4" returned: 0 in 0.901s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:33 devstack sudo[88627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4
Feb 27 02:07:33 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:33 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d" returned: 0 in 0.831s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cc13e2-99b2-4310-b24b-d8408bc86faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9561664-424b-451f-b228-46b810f8921d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6c92c6-6353-45c8-be16-93972886f96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:34 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Volume volume-e9561664-424b-451f-b228-46b810f8921d (e9561664-424b-451f-b228-46b810f8921d): created successfully
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6c92c6-6353-45c8-be16-93972886f96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Flow 'volume_create_manager' (8b663036-8b20-431b-ae42-f25912b8bfcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:34 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ca21a74d-19c5-440f-90a9-2096d66a19a2 tempest-VolumesActionsTest-1876194107 None] Created volume successfully.
Feb 27 02:07:34 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5" returned: 0 in 0.606s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:34 devstack sudo[88633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076
Feb 27 02:07:34 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:34 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4" returned: 0 in 0.553s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4" released by "delete_volume" :: held 1.491s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created reservations ['f5603fae-2bf2-4d64-b30a-e76a1a0976b6', '3184021a-69fd-42fe-9eb7-7e6a140259e4', 'd30ea67d-869d-4ce5-b78a-2abf5f398880', '2db5af14-980f-4363-b283-9974f14c5223'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:34 devstack sudo[88635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:34 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:35 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076" returned: 0 in 0.650s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:35 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.518s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:35 devstack sudo[88641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076
Feb 27 02:07:35 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:35 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Deleted volume successfully.
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-de5d0f4d-7625-4aee-9245-6885bbefb95b tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-9eb4ca9c-42b3-4a06-9ac0-3a5c25b904e4-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-146221e3-f722-42b2-a6b7-6ff11cc3bf63-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-146221e3-f722-42b2-a6b7-6ff11cc3bf63-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-quobyte-146221e3-f722-42b2-a6b7-6ff11cc3bf63" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-146221e3-f722-42b2-a6b7-6ff11cc3bf63" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf2e107-add7-41ce-b30d-11dc1368a787]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:35 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63
Feb 27 02:07:35 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "cinder-e9561664-424b-451f-b228-46b810f8921d-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Lock "cinder-e9561664-424b-451f-b228-46b810f8921d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "cinder-quobyte-e9561664-424b-451f-b228-46b810f8921d" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Lock "cinder-quobyte-e9561664-424b-451f-b228-46b810f8921d" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cacf2bd-fa18-481f-bcf0-041d467157aa]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:35 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5.68124db1-12f8-485c-adcb-164263c19076" returned: 0 in 0.579s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:35 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d
Feb 27 02:07:35 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-68124db1-12f8-485c-adcb-164263c19076" released by "_delete_snapshot" :: held 2.848s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-4652f093-9b33-4be5-b085-a67ca7b0e1c5" released by "delete_snapshot" :: held 2.867s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:35 devstack cinder-volume[83140]: WARNING cinder.quota [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1186713343 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1186713343, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:07:35 devstack cinder-volume[83140]: WARNING cinder.quota [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1186713343 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1186713343, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] Created reservations ['f4b74c0e-5c67-4b62-9768-7f5c0a7b5508', '630cda6a-84b8-4757-a282-a3c783fb6c01', 'b50abdbd-a419-4454-8041-999b175cd8c9', '849b8fda-ed79-49c3-8fcf-f80f4f052f40'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:35 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4b0cb27e-0d57-4859-83ea-1b480985919e tempest-GroupSnapshotsTest-76967834 None] group_snapshot 8d256e29-fd2a-49f5-91ec-b2510175d219: deleted successfully
Feb 27 02:07:35 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63" returned: 0 in 0.654s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:35 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63
Feb 27 02:07:35 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:36 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d" returned: 0 in 0.610s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:36 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d
Feb 27 02:07:36 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "cinder-quobyte-4652f093-9b33-4be5-b085-a67ca7b0e1c5" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-4652f093-9b33-4be5-b085-a67ca7b0e1c5" acquired by "delete_volume" :: waited 0.019s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[779263c5-e75f-4dee-9276-4698e2a3c5af]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:36 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-146221e3-f722-42b2-a6b7-6ff11cc3bf63" returned: 0 in 0.482s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-146221e3-f722-42b2-a6b7-6ff11cc3bf63" released by "delete_volume" :: held 1.185s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created reservations ['5cc2b7e7-d30f-42cb-9478-a4497c73982b', '2eaaaaf5-069e-4c9a-a941-fa2dfe163a98', '9ee44e91-12e6-4309-b09d-16eef94bc418', 'b82764d3-0b6c-4179-86ce-93802057a453'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:36 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5
Feb 27 02:07:36 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:36 devstack sudo[88661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:36 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:36 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e9561664-424b-451f-b228-46b810f8921d" returned: 0 in 0.554s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Lock "cinder-quobyte-e9561664-424b-451f-b228-46b810f8921d" released by "delete_volume" :: held 1.208s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Created reservations ['5db37949-e332-41e2-a0c3-9cfb6f627b9e', 'cb060789-14e6-48d3-9304-9a3b36078bfe', 'a1e855bd-3089-4709-8882-816b579db080', '5a1cdf96-0ba7-4085-936b-4ec102ace3e6'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:36 devstack sudo[88664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:36 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:36 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.477s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:36 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:36 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Deleted volume successfully.
Feb 27 02:07:36 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5" returned: 0 in 0.640s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-869b1f7f-d125-45ea-af15-a7aa3e867a03 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-146221e3-f722-42b2-a6b7-6ff11cc3bf63-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:37 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5
Feb 27 02:07:37 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:37 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.484s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:37 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Deleted volume successfully.
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0b7dcb01-39e9-44c0-ab94-b4cf8e7bb435 tempest-VolumesActionsTest-1876194107 None] Lock "cinder-e9561664-424b-451f-b228-46b810f8921d-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-1dfdad2c-f7c4-4083-b342-6227c202f3df-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-1dfdad2c-f7c4-4083-b342-6227c202f3df-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "cinder-quobyte-1dfdad2c-f7c4-4083-b342-6227c202f3df" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-1dfdad2c-f7c4-4083-b342-6227c202f3df" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25c7ea8-794e-457c-b3f1-951777f51ca8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:37 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4652f093-9b33-4be5-b085-a67ca7b0e1c5" returned: 0 in 0.509s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Lock "cinder-quobyte-4652f093-9b33-4be5-b085-a67ca7b0e1c5" released by "delete_volume" :: held 1.191s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:37 devstack sudo[88674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df
Feb 27 02:07:37 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Created reservations ['dbee28f8-2110-43a1-ad69-e4d6c461a049'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:37 devstack cinder-volume[83140]: WARNING cinder.quota [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1186713343 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1186713343, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Created reservations ['7652fc82-d630-4e28-83ee-32cf79cb6e3b', 'cbc73140-b1d7-48c1-af37-3cdaaa6b1b85', '677d6a9d-45ba-4ed5-a8ea-85cd26b5ad61', '10ec6aa7-53cd-41f4-90bf-9b266d0b9521'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:37 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:37 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:38 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df" returned: 0 in 0.599s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:38 devstack sudo[88681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df
Feb 27 02:07:38 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:38 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.526s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:38 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-cec36299-0eed-4a9f-8399-cdbbaec898aa tempest-GroupSnapshotsTest-76967834 None] Delete group completed successfully.
Feb 27 02:07:38 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1dfdad2c-f7c4-4083-b342-6227c202f3df" returned: 0 in 0.684s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-quobyte-1dfdad2c-f7c4-4083-b342-6227c202f3df" released by "delete_volume" :: held 1.311s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Created reservations ['b34098b5-108f-451f-a3b7-bd08e8def0f7', '143e885c-2c93-4e76-bb6e-db4d88af6c01', 'e12e55ec-6e63-469f-97c8-cd73368d4e06', 'eaec93cd-1d00-4b53-9cbb-39703a6f9a33'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:38 devstack sudo[88685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:07:38 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:39 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.705s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:39 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:07:39 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Deleted volume successfully.
Feb 27 02:07:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-796dee07-bccc-4850-ac5d-b547379249d6 tempest-CreateVolumesFromSourceVolumeTest-1276446305 None] Lock "cinder-1dfdad2c-f7c4-4083-b342-6227c202f3df-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Flow 'volume_create_manager' (c61865bc-e6e8-4d40-a69c-caea767e15ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a6f537-2d30-4acd-96b6-2e3c31af35e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a6f537-2d30-4acd-96b6-2e3c31af35e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1457495097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95b3146-99d5-43c7-b5cc-97039f46f6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fb76d702564064b67ad3af49b345c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:46Z,use_quota=True,user_id='feec7cccb3e04591a2d4c59aeaa76756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0041a384-3496-4fdf-a548-201b8b33257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0041a384-3496-4fdf-a548-201b8b33257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c896cff-e225-4bd0-96cd-a354e703073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c896cff-e225-4bd0-96cd-a354e703073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95b3146-99d5-43c7-b5cc-97039f46f6b3', 'volume_name': 'volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8470c4-db33-437f-8223-1972982622f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8470c4-db33-437f-8223-1972982622f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59badcc-5509-4c51-8c30-4d3f8e0e5258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:45 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Volume a95b3146-99d5-43c7-b5cc-97039f46f6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3', 'volume_size': 1}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1457495097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95b3146-99d5-43c7-b5cc-97039f46f6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fb76d702564064b67ad3af49b345c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:46Z,use_quota=True,user_id='feec7cccb3e04591a2d4c59aeaa76756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Creating volume a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:45 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:45 devstack sudo[88731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 1073741824
Feb 27 02:07:45 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:46 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 1073741824" returned: 0 in 0.654s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:46 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3
Feb 27 02:07:46 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:46 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3" returned: 0 in 0.550s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59badcc-5509-4c51-8c30-4d3f8e0e5258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dffb679-22a0-4166-b342-a189e51cea31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:46 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Volume volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 (a95b3146-99d5-43c7-b5cc-97039f46f6b3): created successfully
Feb 27 02:07:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dffb679-22a0-4166-b342-a189e51cea31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Flow 'volume_create_manager' (c61865bc-e6e8-4d40-a69c-caea767e15ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:46 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-eff481e0-28f9-4435-b7a5-1c7aa3b6209f tempest-SnapshotDependencyTests-1314129509 None] Created volume successfully.
Feb 27 02:07:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-f8e8d51d-4ba1-48f1-8290-2994e2b04c71 tempest-GroupSnapshotsV319Test-1714176205 None] Group tempest-GroupSnapshotsV319Test-Group-1595988638: creating
Feb 27 02:07:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-f8e8d51d-4ba1-48f1-8290-2994e2b04c71 tempest-GroupSnapshotsV319Test-1714176205 None] Group tempest-GroupSnapshotsV319Test-Group-1595988638: created successfully
Feb 27 02:07:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-f8e8d51d-4ba1-48f1-8290-2994e2b04c71 tempest-GroupSnapshotsV319Test-1714176205 None] Create group completed successfully.
Feb 27 02:07:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Creating offline snapshot 9b61271c-81de-4ae2-b7e5-5bd31c260951 of volume a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:07:47 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[673a5044-7d94-41c3-bb60-196b8cff62a6]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:48 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3
Feb 27 02:07:48 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:48 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3" returned: 0 in 0.743s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:48 devstack sudo[88747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 1G
Feb 27 02:07:48 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Flow 'volume_create_manager' (0cea98e7-545c-4e2e-8221-b4f48464bc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de96dc5-e639-48b6-984e-efe7f3de64ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de96dc5-e639-48b6-984e-efe7f3de64ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1665536196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=56148d3a-25aa-45e0-bae7-b94a5c0e231a,host='devstack@QuobyteHD#QuobyteHD',id=9e0b751c-f4ef-406d-9307-5edfe04e2c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590b54bc0ef745f4ad99301c8adf2e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:49Z,use_quota=True,user_id='f4bf638dac394313b7675413093b2203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9b86683-e98f-49ef-820a-834381c15db7),volume_type_id=d9b86683-e98f-49ef-820a-834381c15db7)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9865204-8095-4df4-bdb8-c0d85f797a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9865204-8095-4df4-bdb8-c0d85f797a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d26965-f91c-4a44-9ba1-8434fe7002ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d26965-f91c-4a44-9ba1-8434fe7002ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0b751c-f4ef-406d-9307-5edfe04e2c4d', 'volume_name': 'volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de79d58d-f984-432e-87f6-50903947ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de79d58d-f984-432e-87f6-50903947ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bbacc4-9c55-40be-8af4-21d0e2fa2d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:48 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Volume 9e0b751c-f4ef-406d-9307-5edfe04e2c4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d', 'volume_size': 1}
Feb 27 02:07:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:49 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 1G" returned: 0 in 0.729s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:49 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951
Feb 27 02:07:49 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:49 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951" returned: 0 in 0.461s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:49 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 is being set with open permissions: ugo+rw
Feb 27 02:07:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:49 devstack sudo[88757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951
Feb 27 02:07:49 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:50 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951" returned: 0 in 0.466s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:50 devstack sudo[88760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.info
Feb 27 02:07:50 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:50 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.info" returned: 0 in 0.437s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:50 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.info is being set with open permissions: ugo+rw
Feb 27 02:07:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:50 devstack sudo[88763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.info
Feb 27 02:07:50 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:51 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.info" returned: 0 in 0.518s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.434s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.397s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=56148d3a-25aa-45e0-bae7-b94a5c0e231a,created_at=2026-02-27T01:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1665536196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=56148d3a-25aa-45e0-bae7-b94a5c0e231a,host='devstack@QuobyteHD#QuobyteHD',id=9e0b751c-f4ef-406d-9307-5edfe04e2c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590b54bc0ef745f4ad99301c8adf2e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:49Z,use_quota=True,user_id='f4bf638dac394313b7675413093b2203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9b86683-e98f-49ef-820a-834381c15db7),volume_type_id=d9b86683-e98f-49ef-820a-834381c15db7)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Creating volume 9e0b751c-f4ef-406d-9307-5edfe04e2c4d {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:51 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:51 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d 1073741824
Feb 27 02:07:51 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0af2ebd4-711f-44b0-be50-da83774ea19f tempest-SnapshotDependencyTests-1314129509 None] Create snapshot completed successfully
Feb 27 02:07:51 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d 1073741824" returned: 0 in 0.619s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:52 devstack sudo[88771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d
Feb 27 02:07:52 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:52 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" returned: 0 in 0.529s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bbacc4-9c55-40be-8af4-21d0e2fa2d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cd9525-f498-40e6-9b9f-f254bdc9b81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:52 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Volume volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d (9e0b751c-f4ef-406d-9307-5edfe04e2c4d): created successfully
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cd9525-f498-40e6-9b9f-f254bdc9b81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Flow 'volume_create_manager' (0cea98e7-545c-4e2e-8221-b4f48464bc6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:52 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-414bedf6-3ec5-4fe2-9412-e042aa8a1b72 tempest-GroupSnapshotsV319Test-1714176205 None] Created volume successfully.
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Flow 'volume_create_manager' (602c9aa7-aa2a-4ec2-9879-3666be96819f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb89074b-a8ac-4ac0-869e-1f3e4415f17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb89074b-a8ac-4ac0-869e-1f3e4415f17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f132e1e-0e03-471c-bbeb-d5c02ed131b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fb76d702564064b67ad3af49b345c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9b61271c-81de-4ae2-b7e5-5bd31c260951,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:53Z,use_quota=True,user_id='feec7cccb3e04591a2d4c59aeaa76756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43308d67-3e9b-4b0c-9c90-d10dd4a1c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43308d67-3e9b-4b0c-9c90-d10dd4a1c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1874ecaf-1282-48b9-b94d-fdda12f90a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1874ecaf-1282-48b9-b94d-fdda12f90a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f132e1e-0e03-471c-bbeb-d5c02ed131b4', 'volume_name': 'volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4', 'volume_size': 1, 'snapshot_id': '9b61271c-81de-4ae2-b7e5-5bd31c260951'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54745772-e37f-411b-a58a-d33fc9a5a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54745772-e37f-411b-a58a-d33fc9a5a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286485d4-a113-4e16-bd37-4e3c38b12157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:52 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Volume 6f132e1e-0e03-471c-bbeb-d5c02ed131b4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4', 'volume_size': 1, 'snapshot_id': '9b61271c-81de-4ae2-b7e5-5bd31c260951'}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "cinder-quobyte-9b61271c-81de-4ae2-b7e5-5bd31c260951-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" by "_create_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-9b61271c-81de-4ae2-b7e5-5bd31c260951-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Creating volume 6f132e1e-0e03-471c-bbeb-d5c02ed131b4 from snapshot 9b61271c-81de-4ae2-b7e5-5bd31c260951 {{(pid=83140) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "cinder-quobyte-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] snapshot: 9b61271c-81de-4ae2-b7e5-5bd31c260951, volume: 6f132e1e-0e03-471c-bbeb-d5c02ed131b4,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[773d93da-221c-42df-b972-740754b7668d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:52 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951
Feb 27 02:07:52 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:53 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] GroupSnapshot 11ce6a39-cdd1-457a-9acd-998420d26bb1: creating.
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Group snapshot 11ce6a39-cdd1-457a-9acd-998420d26bb1: creating. {{(pid=83140) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:53 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951" returned: 0 in 0.652s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2554bc-798f-449e-b216-57b9c6f4516e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:53 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3
Feb 27 02:07:53 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Flow 'volume_create_manager' (946fba12-ad65-45bf-a5fc-8bbdd57be074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db31b637-8395-42c1-a360-b95c898e413b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db31b637-8395-42c1-a360-b95c898e413b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-156518435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400b412a-9a53-41e5-8b1f-fcf23b5e29e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ae58166c554b60a6ce84ccf0f2a79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:54Z,use_quota=True,user_id='837904c0f5da46508c9c1cb0d1ff1436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8091301f-0385-411d-a45a-2eeb80c668fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8091301f-0385-411d-a45a-2eeb80c668fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560921e7-d2d2-4098-bc3c-b77b43882f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560921e7-d2d2-4098-bc3c-b77b43882f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400b412a-9a53-41e5-8b1f-fcf23b5e29e9', 'volume_name': 'volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6861ec62-a71d-47bb-b5f7-371f13c763ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6861ec62-a71d-47bb-b5f7-371f13c763ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de9889e-273b-4d12-975e-f5e508dd5782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:53 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Volume 400b412a-9a53-41e5-8b1f-fcf23b5e29e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9', 'volume_size': 1}
Feb 27 02:07:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:07:54 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3" returned: 0 in 0.572s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:54 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:07:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:54 devstack sudo[88785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4
Feb 27 02:07:54 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:56 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" returned: 0 in 2.179s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:56 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6002ce5-aaa0-4879-bd51-39fbf9008f05]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:56 devstack sudo[88797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3
Feb 27 02:07:56 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:56 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3" returned: 0 in 0.665s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:56 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:07:56 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Converted 1024.00 MB image at 469.71 MB/s
Feb 27 02:07:56 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4 is being set with open permissions: ugo+rw
Feb 27 02:07:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:56 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4
Feb 27 02:07:56 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:57 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" returned: 0 in 0.451s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" released by "_copy_volume_from_snapshot" :: held 4.592s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-9b61271c-81de-4ae2-b7e5-5bd31c260951-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" released by "_create_volume_from_snapshot" :: held 4.613s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.623s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.915s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Creating offline snapshot e9b868b1-e794-41c5-bf8a-f12cc85a3cee of volume 9e0b751c-f4ef-406d-9307-5edfe04e2c4d {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286485d4-a113-4e16-bd37-4e3c38b12157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4', 'volume_size': 1, 'snapshot_id': '9b61271c-81de-4ae2-b7e5-5bd31c260951'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fce08a-508f-484d-845b-9c26919d9e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4e86b3-7ed3-443c-a925-8ec20587a153]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Volume volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4 (6f132e1e-0e03-471c-bbeb-d5c02ed131b4): created successfully
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fce08a-508f-484d-845b-9c26919d9e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Flow 'volume_create_manager' (602c9aa7-aa2a-4ec2-9879-3666be96819f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:07:57 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b7e4be27-07df-4b56-9bc0-f5240e43b74f tempest-SnapshotDependencyTests-1314129509 None] Created volume successfully.
Feb 27 02:07:57 devstack sudo[88807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d
Feb 27 02:07:57 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:57 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" returned: 0 in 0.528s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:57 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee 1G
Feb 27 02:07:57 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "cinder-9b61271c-81de-4ae2-b7e5-5bd31c260951-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-9b61271c-81de-4ae2-b7e5-5bd31c260951-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "cinder-quobyte-a95b3146-99d5-43c7-b5cc-97039f46f6b3" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-a95b3146-99d5-43c7-b5cc-97039f46f6b3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "cinder-quobyte-9b61271c-81de-4ae2-b7e5-5bd31c260951" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-9b61271c-81de-4ae2-b7e5-5bd31c260951" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Deleting offline snapshot 9b61271c-81de-4ae2-b7e5-5bd31c260951 of volume a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] snapshot_file for this snap is: volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f25078-4aed-4269-b5a9-e64ff7ed514f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:58 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951
Feb 27 02:07:58 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:58 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee 1G" returned: 0 in 0.630s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:58 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee
Feb 27 02:07:58 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:58 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951" returned: 0 in 0.646s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a4da2a-920d-46f2-ace1-5fea75cabdbe]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:07:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:58 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3
Feb 27 02:07:58 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:59 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee" returned: 0 in 0.677s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:59 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:07:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:59 devstack sudo[88829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee
Feb 27 02:07:59 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:59 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3" returned: 0 in 0.706s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:59 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951
Feb 27 02:07:59 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:59 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee" returned: 0 in 0.447s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:07:59 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.info
Feb 27 02:07:59 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:07:59 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Feb 27 02:07:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951" returned: 0 in 0.483s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:07:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:00 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951
Feb 27 02:08:00 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:00 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.info" returned: 0 in 0.454s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:00 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.info is being set with open permissions: ugo+rw: NotImplementedError
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:00 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.info
Feb 27 02:08:00 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:00 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3.9b61271c-81de-4ae2-b7e5-5bd31c260951" returned: 0 in 0.458s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-9b61271c-81de-4ae2-b7e5-5bd31c260951" released by "_delete_snapshot" :: held 2.361s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-a95b3146-99d5-43c7-b5cc-97039f46f6b3" released by "delete_snapshot" :: held 2.380s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Created reservations ['4b10343a-98dc-481d-8255-6f6f0cc7379f', '2254e733-37a9-408c-be4f-e41bf1fd3b07', 'f5293375-27cf-4463-9a91-e8142e56e0c0', '90c828c1-75ce-4045-8a37-858276852793'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:00 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Delete snapshot completed successfully.
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4efad692-7eb2-47e2-a663-86a4f2388984 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-9b61271c-81de-4ae2-b7e5-5bd31c260951-delete_snapshot" released by "delete_snapshot" :: held 2.484s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:00 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.info" returned: 0 in 0.445s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.284s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.914s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-156518435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400b412a-9a53-41e5-8b1f-fcf23b5e29e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ae58166c554b60a6ce84ccf0f2a79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:54Z,use_quota=True,user_id='837904c0f5da46508c9c1cb0d1ff1436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Creating volume 400b412a-9a53-41e5-8b1f-fcf23b5e29e9 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:00 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:00 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9 1073741824
Feb 27 02:08:00 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:00 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-71c9caa4-5f72-4653-8125-9b76061caec6 tempest-GroupSnapshotsV319Test-1714176205 None] group_snapshot 11ce6a39-cdd1-457a-9acd-998420d26bb1: created successfully
Feb 27 02:08:01 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9 1073741824" returned: 0 in 0.524s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:01 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9
Feb 27 02:08:01 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "cinder-a95b3146-99d5-43c7-b5cc-97039f46f6b3-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-a95b3146-99d5-43c7-b5cc-97039f46f6b3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "cinder-quobyte-a95b3146-99d5-43c7-b5cc-97039f46f6b3" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-a95b3146-99d5-43c7-b5cc-97039f46f6b3" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f00efc-e618-4324-9ba9-88b2a2ac21f8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:01 devstack sudo[88856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3
Feb 27 02:08:01 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:01 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9" returned: 0 in 0.464s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de9889e-273b-4d12-975e-f5e508dd5782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4f6f9a-b820-42d9-be4e-5ed3c3a4b0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:01 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Volume volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9 (400b412a-9a53-41e5-8b1f-fcf23b5e29e9): created successfully
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4f6f9a-b820-42d9-be4e-5ed3c3a4b0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Flow 'volume_create_manager' (946fba12-ad65-45bf-a5fc-8bbdd57be074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:01 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4c79060f-0b8b-47b7-b36c-4424c01f99c0 tempest-VolumesTransfersTest-1944290105 None] Created volume successfully.
Feb 27 02:08:01 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3" returned: 0 in 0.547s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:01 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3
Feb 27 02:08:01 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:02 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] group_snapshot 11ce6a39-cdd1-457a-9acd-998420d26bb1: deleting
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] group_snapshot 11ce6a39-cdd1-457a-9acd-998420d26bb1: deleting {{(pid=83140) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Acquiring lock "cinder-quobyte-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "cinder-quobyte-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Acquiring lock "cinder-quobyte-e9b868b1-e794-41c5-bf8a-f12cc85a3cee" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "cinder-quobyte-e9b868b1-e794-41c5-bf8a-f12cc85a3cee" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Deleting offline snapshot e9b868b1-e794-41c5-bf8a-f12cc85a3cee of volume 9e0b751c-f4ef-406d-9307-5edfe04e2c4d {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] snapshot_file for this snap is: volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0e7b1e-dad8-4856-ab45-4f7e86fc7071]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:02 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee
Feb 27 02:08:02 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:02 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a95b3146-99d5-43c7-b5cc-97039f46f6b3" returned: 0 in 0.575s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-a95b3146-99d5-43c7-b5cc-97039f46f6b3" released by "delete_volume" :: held 1.160s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Created reservations ['9117383d-4bfe-4fb0-b99b-d73f68cd197d', '123791cd-7c00-4c33-9d96-357f76068ca9', 'd4884249-a463-486b-923f-85dfc0b4329a', '41cfa19a-077a-49eb-b213-9d30ed021319'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:02 devstack sudo[88867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:02 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:02 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-612d5da5-6d09-4ffc-b592-dd9b96e77dbc tempest-VolumesTransfersTest-405585575 None] Transfer volume completed successfully.
Feb 27 02:08:02 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee" returned: 0 in 0.609s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31c0422-56b1-4c5f-a39a-8a2fe7071ba1]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:02 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d
Feb 27 02:08:02 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:03 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.471s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:03 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Deleted volume successfully.
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab44cd4a-4515-487c-8449-78e694adf448 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-a95b3146-99d5-43c7-b5cc-97039f46f6b3-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:03 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" returned: 0 in 0.515s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:03 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee
Feb 27 02:08:03 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "cinder-6f132e1e-0e03-471c-bbeb-d5c02ed131b4-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-6f132e1e-0e03-471c-bbeb-d5c02ed131b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "cinder-quobyte-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[464f12e9-b982-4bb6-818b-c0de79e11cac]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Acquiring lock "cinder-400b412a-9a53-41e5-8b1f-fcf23b5e29e9-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Lock "cinder-400b412a-9a53-41e5-8b1f-fcf23b5e29e9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:03 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4
Feb 27 02:08:03 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Acquiring lock "cinder-quobyte-400b412a-9a53-41e5-8b1f-fcf23b5e29e9" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Lock "cinder-quobyte-400b412a-9a53-41e5-8b1f-fcf23b5e29e9" acquired by "delete_volume" :: waited 0.020s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88a285e-d8f1-413c-af99-f3a86bd7453e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:03 devstack sudo[88883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9
Feb 27 02:08:03 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:03 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee" returned: 0 in 0.630s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:04 devstack sudo[88888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee
Feb 27 02:08:04 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:04 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" returned: 0 in 0.543s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:04 devstack sudo[88893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4
Feb 27 02:08:04 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:04 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9" returned: 0 in 0.538s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:04 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9
Feb 27 02:08:04 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:04 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d.e9b868b1-e794-41c5-bf8a-f12cc85a3cee" returned: 0 in 0.489s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "cinder-quobyte-e9b868b1-e794-41c5-bf8a-f12cc85a3cee" released by "_delete_snapshot" :: held 2.313s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "cinder-quobyte-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" released by "delete_snapshot" :: held 2.326s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:04 devstack cinder-volume[83140]: WARNING cinder.quota [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1333649360 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1333649360, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:08:04 devstack cinder-volume[83140]: WARNING cinder.quota [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1333649360 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1333649360, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] Created reservations ['57316df5-48f3-4103-a1ea-0fb1e180a807', '5e49df4d-4e2f-46f3-a412-b179450f41ed', '0a51e76e-7d51-4e40-b1f2-dc91c68a6fc4', '694db7ea-e0c2-4cb7-bfc8-d7b47dc0f422'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:04 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-62b9f595-2c6f-4198-8dbb-ceced3de3cf4 tempest-GroupSnapshotsV319Test-1714176205 None] group_snapshot 11ce6a39-cdd1-457a-9acd-998420d26bb1: deleted successfully
Feb 27 02:08:04 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" returned: 0 in 0.560s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-quobyte-6f132e1e-0e03-471c-bbeb-d5c02ed131b4" released by "delete_volume" :: held 1.132s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:04 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-400b412a-9a53-41e5-8b1f-fcf23b5e29e9" returned: 0 in 0.480s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Lock "cinder-quobyte-400b412a-9a53-41e5-8b1f-fcf23b5e29e9" released by "delete_volume" :: held 1.040s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Created reservations ['81fa840d-1ad2-4700-85c7-81bf57eddde9', '82517a98-6cd5-4f32-b734-f4279d60d650', '882aad5f-2a97-4325-86ca-88f18ed7141f', '1d86e9f6-2776-4904-975a-ae16393bb043'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Created reservations ['3b30f345-16d0-43fa-902a-11d122798ef6', '950ba138-5fb5-43f3-b7f8-7f6cd9fa4a0a', '16bc0f40-1bad-4557-a367-072c3312dd77', '7df2fae4-8768-4065-a06f-c2c51e99d92e'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:04 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:04 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:04 devstack sudo[88905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:04 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:05 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.424s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:05 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Deleted volume successfully.
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fafbd1e7-2347-4b91-bf9e-16909672ab66 tempest-SnapshotDependencyTests-1314129509 None] Lock "cinder-6f132e1e-0e03-471c-bbeb-d5c02ed131b4-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:05 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.485s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:05 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Deleted volume successfully.
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b7a828a7-10c1-414f-95b7-b0fabb7748f0 tempest-VolumesTransfersTest-1155578172 None] Lock "cinder-400b412a-9a53-41e5-8b1f-fcf23b5e29e9-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Acquiring lock "cinder-quobyte-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "cinder-quobyte-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[457c5312-a0bf-4f12-b1e5-b47c2dd2021c]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:05 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d
Feb 27 02:08:05 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:06 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" returned: 0 in 0.649s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:06 devstack sudo[88914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d
Feb 27 02:08:06 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Flow 'volume_create_manager' (cfb496ea-0cce-4766-9727-3717f8e67e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed61b4ac-79a6-4a04-a09c-6e08605b2246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed61b4ac-79a6-4a04-a09c-6e08605b2246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-837249107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c47c60-2a4f-48cc-83af-8907c098af1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ae58166c554b60a6ce84ccf0f2a79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:06Z,use_quota=True,user_id='837904c0f5da46508c9c1cb0d1ff1436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930d3da0-5a77-4d43-a53c-274543788c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930d3da0-5a77-4d43-a53c-274543788c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993c1232-898d-43e8-9611-defaa177c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993c1232-898d-43e8-9611-defaa177c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c47c60-2a4f-48cc-83af-8907c098af1c', 'volume_name': 'volume-57c47c60-2a4f-48cc-83af-8907c098af1c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5d8d34-f906-4f84-97d0-b676badb8175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5d8d34-f906-4f84-97d0-b676badb8175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35fde51-2003-459b-926f-409b444b08a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:06 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Volume 57c47c60-2a4f-48cc-83af-8907c098af1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c47c60-2a4f-48cc-83af-8907c098af1c', 'volume_size': 1}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-837249107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c47c60-2a4f-48cc-83af-8907c098af1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ae58166c554b60a6ce84ccf0f2a79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:06Z,use_quota=True,user_id='837904c0f5da46508c9c1cb0d1ff1436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Creating volume 57c47c60-2a4f-48cc-83af-8907c098af1c {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:06 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:06 devstack sudo[88916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c 1073741824
Feb 27 02:08:06 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:06 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" returned: 0 in 0.533s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "cinder-quobyte-9e0b751c-f4ef-406d-9307-5edfe04e2c4d" released by "delete_volume" :: held 1.218s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Created reservations ['963d83e1-417b-4a38-877e-5a6fdcd66f34'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:06 devstack cinder-volume[83140]: WARNING cinder.quota [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1333649360 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1333649360, it is now deprecated. Please use the default quota class for default quota.
Feb 27 02:08:06 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Created reservations ['c8b74b19-da59-496d-a3da-8a7944581697', 'b59cbf34-efac-44e9-abae-e8bb781450b4', '359d6286-9493-4f29-9da2-c6f64f967a50', 'fca7da25-8b2f-47c7-8d49-e8dfefe3aa08'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:07 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c 1073741824" returned: 0 in 0.662s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:07 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c
Feb 27 02:08:07 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:07 devstack sudo[88925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:07 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:07 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c" returned: 0 in 0.488s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35fde51-2003-459b-926f-409b444b08a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c47c60-2a4f-48cc-83af-8907c098af1c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df1f0bf-f024-4b50-a0a2-4c37ecb9e20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:07 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Volume volume-57c47c60-2a4f-48cc-83af-8907c098af1c (57c47c60-2a4f-48cc-83af-8907c098af1c): created successfully
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df1f0bf-f024-4b50-a0a2-4c37ecb9e20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Flow 'volume_create_manager' (cfb496ea-0cce-4766-9727-3717f8e67e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d58e9808-a1e6-4b80-9745-aae9262abc47 tempest-VolumesTransfersTest-1944290105 None] Created volume successfully.
Feb 27 02:08:07 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.607s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:07 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-46ec66b8-037c-4d21-96a5-6c58ac7d3e09 tempest-GroupSnapshotsV319Test-1714176205 None] Delete group completed successfully.
Feb 27 02:08:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Acquiring lock "cinder-57c47c60-2a4f-48cc-83af-8907c098af1c-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Lock "cinder-57c47c60-2a4f-48cc-83af-8907c098af1c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Acquiring lock "cinder-quobyte-57c47c60-2a4f-48cc-83af-8907c098af1c" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Lock "cinder-quobyte-57c47c60-2a4f-48cc-83af-8907c098af1c" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:08 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0166ca6-9a1c-45ce-9831-ffd76a5a2a47]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:08 devstack sudo[88930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c
Feb 27 02:08:08 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:09 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c" returned: 0 in 0.719s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:09 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c
Feb 27 02:08:09 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:10 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57c47c60-2a4f-48cc-83af-8907c098af1c" returned: 0 in 0.554s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Lock "cinder-quobyte-57c47c60-2a4f-48cc-83af-8907c098af1c" released by "delete_volume" :: held 1.301s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Created reservations ['2ef31271-6bba-4123-821f-c78b50f96530', '0f04513a-cef1-43ba-922c-14560c8080af', 'c6f4da1d-dc78-405e-ad84-896c6356dcd3', 'ac408772-f08c-40bb-94aa-03f228ee834d'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:10 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:10 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:10 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.585s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:10 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Deleted volume successfully.
Feb 27 02:08:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-d2e5507b-d186-4f04-97c0-9a1e79e57d7f tempest-VolumesTransfersTest-1155578172 None] Lock "cinder-57c47c60-2a4f-48cc-83af-8907c098af1c-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (7c1d7899-2b30-4edf-ac55-233156b5f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324b91cd-4704-4741-ad61-5fad0fccf4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324b91cd-4704-4741-ad61-5fad0fccf4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1346540545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c57cfd6-1f43-470b-8b77-183d25a01663,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:16Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22e5c16-f1b6-45a7-9857-819e5c432f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22e5c16-f1b6-45a7-9857-819e5c432f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5447ec-e29c-44b1-a1b2-dc38d547e890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5447ec-e29c-44b1-a1b2-dc38d547e890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c57cfd6-1f43-470b-8b77-183d25a01663', 'volume_name': 'volume-2c57cfd6-1f43-470b-8b77-183d25a01663', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd303c6-8b2f-4553-86ac-c2a3a30044e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd303c6-8b2f-4553-86ac-c2a3a30044e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce17bf91-8805-472b-93a1-9a0d758aeef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:16 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Volume 2c57cfd6-1f43-470b-8b77-183d25a01663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c57cfd6-1f43-470b-8b77-183d25a01663', 'volume_size': 1}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1346540545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c57cfd6-1f43-470b-8b77-183d25a01663,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:16Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Creating volume 2c57cfd6-1f43-470b-8b77-183d25a01663 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:16 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:16 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663 1073741824
Feb 27 02:08:16 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:17 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663 1073741824" returned: 0 in 0.606s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:17 devstack sudo[88950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663
Feb 27 02:08:17 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:17 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663" returned: 0 in 0.469s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce17bf91-8805-472b-93a1-9a0d758aeef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c57cfd6-1f43-470b-8b77-183d25a01663', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b81f083-1eff-4e84-b0bb-9a0695e21598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:17 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Volume volume-2c57cfd6-1f43-470b-8b77-183d25a01663 (2c57cfd6-1f43-470b-8b77-183d25a01663): created successfully
Feb 27 02:08:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b81f083-1eff-4e84-b0bb-9a0695e21598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:17 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (7c1d7899-2b30-4edf-ac55-233156b5f366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:17 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7ff89581-8548-423d-b118-4ff07bac37f2 tempest-VolumesGetTest-977632775 None] Created volume successfully.
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (09ed9990-cdc8-4a0f-9d0d-91d92d0ab621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c482f84f-e809-4b7f-8f39-7d4dbdb72ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c482f84f-e809-4b7f-8f39-7d4dbdb72ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1850379645',display_name='tempest-VolumesGetTest-Volume-962937645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d09329-fe7e-45f9-80f5-87c2be266d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:19Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec904f19-d4cf-41b0-b997-4a6b750c5de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec904f19-d4cf-41b0-b997-4a6b750c5de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e04a34-03d8-4c3e-99f3-031e0de2ce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e04a34-03d8-4c3e-99f3-031e0de2ce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d09329-fe7e-45f9-80f5-87c2be266d1f', 'volume_name': 'volume-29d09329-fe7e-45f9-80f5-87c2be266d1f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0df3c23-cdaa-419c-b6ed-26faa7a1a610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0df3c23-cdaa-419c-b6ed-26faa7a1a610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e7c90d-7cc3-4e52-aea5-30c197eb5198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Volume 29d09329-fe7e-45f9-80f5-87c2be266d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d09329-fe7e-45f9-80f5-87c2be266d1f', 'volume_size': 1}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1850379645',display_name='tempest-VolumesGetTest-Volume-962937645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d09329-fe7e-45f9-80f5-87c2be266d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:19Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Creating volume 29d09329-fe7e-45f9-80f5-87c2be266d1f {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:19 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:19 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f 1073741824
Feb 27 02:08:19 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:19 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f 1073741824" returned: 0 in 0.584s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:20 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f
Feb 27 02:08:20 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:20 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f" returned: 0 in 0.521s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e7c90d-7cc3-4e52-aea5-30c197eb5198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d09329-fe7e-45f9-80f5-87c2be266d1f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3afa93-9ef2-4df1-9936-9e665f85ebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:20 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Volume volume-29d09329-fe7e-45f9-80f5-87c2be266d1f (29d09329-fe7e-45f9-80f5-87c2be266d1f): created successfully
Feb 27 02:08:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3afa93-9ef2-4df1-9936-9e665f85ebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (09ed9990-cdc8-4a0f-9d0d-91d92d0ab621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:20 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4a3b8a2a-44e0-44f7-bcf6-06414fe20458 tempest-VolumesGetTest-977632775 None] Created volume successfully.
Feb 27 02:08:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-29d09329-fe7e-45f9-80f5-87c2be266d1f-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Lock "cinder-29d09329-fe7e-45f9-80f5-87c2be266d1f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-quobyte-29d09329-fe7e-45f9-80f5-87c2be266d1f" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-29d09329-fe7e-45f9-80f5-87c2be266d1f" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:21 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9acd5c9-cb13-42ab-a7dc-a1c4278cd90f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:21 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f
Feb 27 02:08:21 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:22 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f" returned: 0 in 0.522s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:22 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f
Feb 27 02:08:22 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:22 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-29d09329-fe7e-45f9-80f5-87c2be266d1f" returned: 0 in 0.455s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-29d09329-fe7e-45f9-80f5-87c2be266d1f" released by "delete_volume" :: held 1.005s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=202,cinder:SELECT=146,cinder:INSERT=49,cinder:DELETE=13 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Created reservations ['f6e88837-e19c-45a2-ad92-ae27cbc24545', '70a6018a-5b47-4815-a158-9fa76d99796f', 'cd6ba782-167e-41bd-bb0c-3388114c8c07', 'a6c611dd-e9c7-439c-9688-29addfbd11f1'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:22 devstack sudo[88969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:22 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:23 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.455s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:23 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:23 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Deleted volume successfully.
Feb 27 02:08:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-19a5c70e-8fd6-42c5-a75e-33b23d0c8b7c tempest-VolumesGetTest-977632775 None] Lock "cinder-29d09329-fe7e-45f9-80f5-87c2be266d1f-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-2c57cfd6-1f43-470b-8b77-183d25a01663-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Lock "cinder-2c57cfd6-1f43-470b-8b77-183d25a01663-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-quobyte-2c57cfd6-1f43-470b-8b77-183d25a01663" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-2c57cfd6-1f43-470b-8b77-183d25a01663" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:23 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b91124c-bd66-4751-b717-9730f100e51f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:23 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663
Feb 27 02:08:23 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:24 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663" returned: 0 in 0.524s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:24 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663
Feb 27 02:08:24 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:24 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c57cfd6-1f43-470b-8b77-183d25a01663" returned: 0 in 0.452s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-2c57cfd6-1f43-470b-8b77-183d25a01663" released by "delete_volume" :: held 0.998s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Created reservations ['ccb1974a-05cb-49c3-b373-a40535311814', '6550a058-7b33-475b-99fe-8af457830c8b', 'f3e92665-e337-4032-b69d-72a3697f4c96', '530b7f24-85eb-4921-aa03-7b2ff80c4896'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:24 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:24 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:25 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.453s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:25 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:25 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Deleted volume successfully.
Feb 27 02:08:25 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6c712eec-ce60-40b9-b965-0af6470bc5d5 tempest-VolumesGetTest-977632775 None] Lock "cinder-2c57cfd6-1f43-470b-8b77-183d25a01663-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (e7fbcfab-7e44-495d-9028-2c47373df19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece0dfa6-0295-4b70-9605-020a967a0632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece0dfa6-0295-4b70-9605-020a967a0632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1583064272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015be97a-e5be-4751-80b9-1d6de69178b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:26Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89edcf03-f4b2-4d9f-be19-d1307da3b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89edcf03-f4b2-4d9f-be19-d1307da3b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced0b812-764a-4ba1-928d-03e7cfdce1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced0b812-764a-4ba1-928d-03e7cfdce1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015be97a-e5be-4751-80b9-1d6de69178b1', 'volume_name': 'volume-015be97a-e5be-4751-80b9-1d6de69178b1', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a2e94e-07f1-4fe8-9010-9a7524ca9111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a2e94e-07f1-4fe8-9010-9a7524ca9111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c23f52-4c91-49d8-9308-d4cfa67516a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:26 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Volume 015be97a-e5be-4751-80b9-1d6de69178b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015be97a-e5be-4751-80b9-1d6de69178b1', 'volume_size': 1}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1583064272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015be97a-e5be-4751-80b9-1d6de69178b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:26Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Creating volume 015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:26 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:26 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 1073741824
Feb 27 02:08:26 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:26 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 1073741824" returned: 0 in 0.558s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:26 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1
Feb 27 02:08:26 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:27 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1" returned: 0 in 0.494s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c23f52-4c91-49d8-9308-d4cfa67516a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015be97a-e5be-4751-80b9-1d6de69178b1', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f982bab-dbae-450b-ac83-eaaddd9f5d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:27 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Volume volume-015be97a-e5be-4751-80b9-1d6de69178b1 (015be97a-e5be-4751-80b9-1d6de69178b1): created successfully
Feb 27 02:08:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f982bab-dbae-450b-ac83-eaaddd9f5d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (e7fbcfab-7e44-495d-9028-2c47373df19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:27 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6166d0ff-97df-4972-a0af-30a516377336 tempest-VolumesGetTest-977632775 None] Created volume successfully.
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (fd349e2a-04c1-45b1-ae00-76d0ec9c11a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633def9c-80ed-46e0-8932-4a9fe56befa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633def9c-80ed-46e0-8932-4a9fe56befa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1926913365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=015be97a-e5be-4751-80b9-1d6de69178b1,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:29Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e439a088-f5fb-41f8-9b28-a708b001c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e439a088-f5fb-41f8-9b28-a708b001c067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654a61f5-bcde-4964-a2b9-1b689b61d9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654a61f5-bcde-4964-a2b9-1b689b61d9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4', 'volume_name': 'volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4', 'volume_size': 1, 'source_volid': '015be97a-e5be-4751-80b9-1d6de69178b1', 'source_volstatus': 'available'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad95309-6359-4cc4-b829-3304e1affb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad95309-6359-4cc4-b829-3304e1affb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5c09b9-2904-405e-a1ff-1b86b1895a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:28 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Volume 30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4', 'volume_size': 1, 'source_volid': '015be97a-e5be-4751-80b9-1d6de69178b1', 'source_volstatus': 'available'}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:28 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Cloning volume 015be97a-e5be-4751-80b9-1d6de69178b1 to volume 30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Creating offline snapshot cbb59e96-d9a9-490a-b693-45b6634cd66e of volume 015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e801338e-89a2-417e-a3f0-f7f1b28c9cda]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:28 devstack sudo[88992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1
Feb 27 02:08:28 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Flow 'volume_create_manager' (85234930-2283-475f-a9ea-c94227337302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38a5b16-552a-479c-9ec0-c7ab72de326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38a5b16-552a-479c-9ec0-c7ab72de326d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-328114413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18865ce7-ad02-45a4-a605-2e9a867035de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd424e3b8ba54616936eab4e57ae209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:29Z,use_quota=True,user_id='fc638c0fa6bd422dabdf78a6010abe8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9201def-93d2-4472-a363-77273b8000d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9201def-93d2-4472-a363-77273b8000d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44b094a-3319-492b-bbeb-cb5cd8463084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44b094a-3319-492b-bbeb-cb5cd8463084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18865ce7-ad02-45a4-a605-2e9a867035de', 'volume_name': 'volume-18865ce7-ad02-45a4-a605-2e9a867035de', 'volume_size': 2}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185f36b6-4e69-4ee8-9d67-b37400c7831a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185f36b6-4e69-4ee8-9d67-b37400c7831a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101faa17-0f90-43db-9c7f-c6a45980e2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:29 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Volume 18865ce7-ad02-45a4-a605-2e9a867035de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18865ce7-ad02-45a4-a605-2e9a867035de', 'volume_size': 2}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:29 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1" returned: 0 in 0.570s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:29 devstack sudo[88997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e 1G
Feb 27 02:08:29 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:29 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e 1G" returned: 0 in 0.510s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015be97a-e5be-4751-80b9-1d6de69178b1 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:29 devstack sudo[89002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015be97a-e5be-4751-80b9-1d6de69178b1 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e
Feb 27 02:08:29 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:30 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015be97a-e5be-4751-80b9-1d6de69178b1 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e" returned: 0 in 0.486s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:30 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e is being set with open permissions: ugo+rw
Feb 27 02:08:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:30 devstack sudo[89007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e
Feb 27 02:08:30 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:30 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e" returned: 0 in 0.453s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:30 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:INSERT=41,cinder:UPDATE=168,cinder:SELECT=142,cinder:DELETE=12 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:08:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:30 devstack sudo[89010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.info
Feb 27 02:08:30 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:31 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.info" returned: 0 in 0.452s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:31 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.info is being set with open permissions: ugo+rw
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:31 devstack sudo[89013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.info
Feb 27 02:08:31 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:31 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.info" returned: 0 in 0.411s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-quobyte-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] snapshot: cbb59e96-d9a9-490a-b693-45b6634cd66e, volume: 30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc6eb20-8e08-4edf-9da4-2fa64c250510]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:31 devstack sudo[89016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e
Feb 27 02:08:31 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:32 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e" returned: 0 in 0.528s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015be97a-e5be-4751-80b9-1d6de69178b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da4a077-9a35-4bbe-93ff-f53b7945c957]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:32 devstack sudo[89021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1
Feb 27 02:08:32 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:32 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:32 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:32 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1" returned: 0 in 0.604s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:08:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:32 devstack sudo[89029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4
Feb 27 02:08:32 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:33 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.470s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:35 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" returned: 0 in 2.243s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:35 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b34c494-6c3b-499d-aeda-8855a603d33f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:35 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1
Feb 27 02:08:35 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:35 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1" returned: 0 in 0.634s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:35 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:08:35 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Converted 1024.00 MB image at 456.28 MB/s
Feb 27 02:08:35 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4 is being set with open permissions: ugo+rw
Feb 27 02:08:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:35 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4
Feb 27 02:08:35 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:36 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" returned: 0 in 0.442s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" released by "_copy_volume_from_snapshot" :: held 4.505s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-quobyte-cbb59e96-d9a9-490a-b693-45b6634cd66e" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-cbb59e96-d9a9-490a-b693-45b6634cd66e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Deleting offline snapshot cbb59e96-d9a9-490a-b693-45b6634cd66e of volume 015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] snapshot_file for this snap is: volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4d85c1-8d06-4038-ae06-f1f8db2cd13b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:36 devstack sudo[89051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e
Feb 27 02:08:36 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:36 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e" returned: 0 in 0.522s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015be97a-e5be-4751-80b9-1d6de69178b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c53bb23-6ea3-402c-b8e1-759725f4c2e5]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:36 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1
Feb 27 02:08:36 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:37 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1" returned: 0 in 0.612s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:37 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e
Feb 27 02:08:37 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:37 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e" returned: 0 in 0.519s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:37 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e
Feb 27 02:08:37 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:38 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1.cbb59e96-d9a9-490a-b693-45b6634cd66e" returned: 0 in 0.491s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-cbb59e96-d9a9-490a-b693-45b6634cd66e" released by "_delete_snapshot" :: held 2.204s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.741s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.265s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-328114413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18865ce7-ad02-45a4-a605-2e9a867035de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd424e3b8ba54616936eab4e57ae209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:29Z,use_quota=True,user_id='fc638c0fa6bd422dabdf78a6010abe8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Creating volume 18865ce7-ad02-45a4-a605-2e9a867035de {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:38 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de 2147483648 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5c09b9-2904-405e-a1ff-1b86b1895a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4', 'volume_size': 1, 'source_volid': '015be97a-e5be-4751-80b9-1d6de69178b1', 'source_volstatus': 'available'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:38 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de 2147483648
Feb 27 02:08:38 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886726d5-1552-4c94-b703-26d04c9f6882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:38 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Volume volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4 (30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4): created successfully
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886726d5-1552-4c94-b703-26d04c9f6882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (fd349e2a-04c1-45b1-ae00-76d0ec9c11a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:38 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-86f037cf-3c62-4a55-9db8-84d894160a26 tempest-VolumesGetTest-977632775 None] Created volume successfully.
Feb 27 02:08:38 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de 2147483648" returned: 0 in 0.553s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:39 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de
Feb 27 02:08:39 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:39 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de" returned: 0 in 0.547s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101faa17-0f90-43db-9c7f-c6a45980e2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18865ce7-ad02-45a4-a605-2e9a867035de', 'volume_size': 2}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b627f073-0a54-4e96-9a38-058d155becd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:39 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Volume volume-18865ce7-ad02-45a4-a605-2e9a867035de (18865ce7-ad02-45a4-a605-2e9a867035de): created successfully
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b627f073-0a54-4e96-9a38-058d155becd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Flow 'volume_create_manager' (85234930-2283-475f-a9ea-c94227337302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:39 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e5566dec-219c-4a3f-a899-3b7da4851436 tempest-VolumesCloneNegativeTest-235588675 None] Created volume successfully.
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (b84d6ca6-e4fd-4fd2-8d4e-979caf34774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a79c9e-7192-41dc-9ef1-5213bc6886ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Acquiring lock "cinder-18865ce7-ad02-45a4-a605-2e9a867035de-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a79c9e-7192-41dc-9ef1-5213bc6886ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-349611730',display_name='tempest-VolumesGetTest-Volume-1818117343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18099231-4e6e-4759-981c-fc6940b0bb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:40Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0ac007-446b-443c-a4d5-99692b9aba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0ac007-446b-443c-a4d5-99692b9aba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9296e415-c83d-4d45-9a53-a4d2d4c787d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9296e415-c83d-4d45-9a53-a4d2d4c787d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18099231-4e6e-4759-981c-fc6940b0bb52', 'volume_name': 'volume-18099231-4e6e-4759-981c-fc6940b0bb52', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2606758-8fba-470d-8c53-9aa0075fae9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2606758-8fba-470d-8c53-9aa0075fae9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b06553-0020-4d2e-a0aa-05cea1666b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:39 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Volume 18099231-4e6e-4759-981c-fc6940b0bb52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18099231-4e6e-4759-981c-fc6940b0bb52', 'volume_size': 1}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-349611730',display_name='tempest-VolumesGetTest-Volume-1818117343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18099231-4e6e-4759-981c-fc6940b0bb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:40Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Creating volume 18099231-4e6e-4759-981c-fc6940b0bb52 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:40 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Lock "cinder-18865ce7-ad02-45a4-a605-2e9a867035de-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:40 devstack sudo[89077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52 1073741824
Feb 27 02:08:40 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Acquiring lock "cinder-quobyte-18865ce7-ad02-45a4-a605-2e9a867035de" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Lock "cinder-quobyte-18865ce7-ad02-45a4-a605-2e9a867035de" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd3334-40da-428b-afd6-652bfccc2dfa]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:40 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de
Feb 27 02:08:40 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:40 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52 1073741824" returned: 0 in 0.591s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:40 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52
Feb 27 02:08:40 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:40 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de" returned: 0 in 0.596s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:40 devstack sudo[89123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de
Feb 27 02:08:40 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:41 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:41 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18865ce7-ad02-45a4-a605-2e9a867035de" returned: 0 in 0.449s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52" returned: 0 in 0.506s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Lock "cinder-quobyte-18865ce7-ad02-45a4-a605-2e9a867035de" released by "delete_volume" :: held 1.079s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b06553-0020-4d2e-a0aa-05cea1666b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18099231-4e6e-4759-981c-fc6940b0bb52', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788630c1-94ac-4ccc-a9ff-d368eb65852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:41 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Volume volume-18099231-4e6e-4759-981c-fc6940b0bb52 (18099231-4e6e-4759-981c-fc6940b0bb52): created successfully
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788630c1-94ac-4ccc-a9ff-d368eb65852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (b84d6ca6-e4fd-4fd2-8d4e-979caf34774a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:41 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2585e3c8-a3ec-4bf0-95d6-2025f42c84ed tempest-VolumesGetTest-977632775 None] Created volume successfully.
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Created reservations ['48f078a7-6dbd-4f46-bc20-4b3770af25b5', 'cf40f7bd-4d4c-4c20-be22-ad575f5cdd39', 'a3eff217-84fe-4168-adf4-509f1d5facd5', '630b67b0-b75d-42c0-a071-3c88e5c8be7e'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:41 devstack sudo[89133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:41 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:41 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.399s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:41 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Deleted volume successfully.
Feb 27 02:08:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ab4abc99-68ba-4ec6-9634-afc3b1355562 tempest-VolumesCloneNegativeTest-235588675 None] Lock "cinder-18865ce7-ad02-45a4-a605-2e9a867035de-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-18099231-4e6e-4759-981c-fc6940b0bb52-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Lock "cinder-18099231-4e6e-4759-981c-fc6940b0bb52-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-quobyte-18099231-4e6e-4759-981c-fc6940b0bb52" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-18099231-4e6e-4759-981c-fc6940b0bb52" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:42 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea15008-2ef7-43ad-896e-6829c4be9c3d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:42 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52
Feb 27 02:08:42 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:42 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52" returned: 0 in 0.551s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:42 devstack sudo[89141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52
Feb 27 02:08:42 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:43 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-18099231-4e6e-4759-981c-fc6940b0bb52" returned: 0 in 0.454s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-18099231-4e6e-4759-981c-fc6940b0bb52" released by "delete_volume" :: held 1.031s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Created reservations ['9b56bf54-3bb8-4b6c-bcb1-48959a105461', '886258f3-8b07-4360-8807-3f78e52acdae', '0db0f1aa-e8d0-4bc3-a7a8-6ee12127f272', 'e5890603-bc0f-4043-a035-9b3a4407cae6'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:43 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:43 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:43 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.452s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:43 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Deleted volume successfully.
Feb 27 02:08:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-02ba36fc-b084-4924-a6a6-adad1e5a32bd tempest-VolumesGetTest-977632775 None] Lock "cinder-18099231-4e6e-4759-981c-fc6940b0bb52-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Lock "cinder-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-quobyte-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:44 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4711c7f-aea2-4279-a068-9f08d82c14ee]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:44 devstack sudo[89148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4
Feb 27 02:08:44 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:44 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" returned: 0 in 0.548s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:44 devstack sudo[89153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4
Feb 27 02:08:44 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:45 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Flow 'volume_create_manager' (34592f50-64ff-43ed-bafb-1ba3ef412384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf082c7-3da1-43f5-ba9d-61b04f150004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" returned: 0 in 0.493s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf082c7-3da1-43f5-ba9d-61b04f150004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-833361564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d485ddd9-df1b-4bfb-a32e-8b6959b6a61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677fc57949b7431ea9ce1c214430d594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:45Z,use_quota=True,user_id='3d00ce8db5ac4c4a868e953b0733fb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e281419-41f0-42aa-83e4-c7bae3943992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e281419-41f0-42aa-83e4-c7bae3943992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fee530d-ae35-46f3-84b0-2cfab042f1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fee530d-ae35-46f3-84b0-2cfab042f1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd485ddd9-df1b-4bfb-a32e-8b6959b6a61e', 'volume_name': 'volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd472828-32dc-433e-830b-7509f9926901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd472828-32dc-433e-830b-7509f9926901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c34bed3-28cc-4e10-b0f7-ba093f1aec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:45 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Volume d485ddd9-df1b-4bfb-a32e-8b6959b6a61e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e', 'volume_size': 1}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-833361564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d485ddd9-df1b-4bfb-a32e-8b6959b6a61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677fc57949b7431ea9ce1c214430d594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:45Z,use_quota=True,user_id='3d00ce8db5ac4c4a868e953b0733fb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Creating volume d485ddd9-df1b-4bfb-a32e-8b6959b6a61e {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:45 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4" released by "delete_volume" :: held 1.116s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:45 devstack sudo[89156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e 1073741824
Feb 27 02:08:45 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Created reservations ['5e71a736-02fe-47e3-8df5-4bdb7c1027e1', 'fd34c4a4-954b-467d-9ed3-a105d8587a62', 'b8428846-5617-4efc-9b2b-f70b9cd5fa2e', '9f62d161-8486-4b34-9e1b-930f00c26017'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:45 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:45 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:46 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:46 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e 1073741824" returned: 0 in 0.530s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.452s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:46 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Deleted volume successfully.
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f8d74bda-c3a8-4efb-b20e-1284de11cde9 tempest-VolumesGetTest-977632775 None] Lock "cinder-30714fc8-ee14-4dfb-8aa9-1a03b4ac85a4-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:46 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e
Feb 27 02:08:46 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:46 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e" returned: 0 in 0.441s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c34bed3-28cc-4e10-b0f7-ba093f1aec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99170300-dfe9-40ec-95e4-1b9afe549e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:46 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Volume volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e (d485ddd9-df1b-4bfb-a32e-8b6959b6a61e): created successfully
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99170300-dfe9-40ec-95e4-1b9afe549e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Flow 'volume_create_manager' (34592f50-64ff-43ed-bafb-1ba3ef412384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:46 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-acffbe71-a370-4501-a7a2-e26482981208 tempest-VolumesNegativeTest-2049163706 None] Created volume successfully.
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-015be97a-e5be-4751-80b9-1d6de69178b1-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Lock "cinder-015be97a-e5be-4751-80b9-1d6de69178b1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-quobyte-015be97a-e5be-4751-80b9-1d6de69178b1" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-015be97a-e5be-4751-80b9-1d6de69178b1" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[3814f6e7-6647-4a08-be79-1f1e4452b1fc]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:46 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1
Feb 27 02:08:46 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:47 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1" returned: 0 in 0.508s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:47 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1
Feb 27 02:08:47 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:47 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-015be97a-e5be-4751-80b9-1d6de69178b1" returned: 0 in 0.528s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-015be97a-e5be-4751-80b9-1d6de69178b1" released by "delete_volume" :: held 1.081s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Created reservations ['cc239580-f5f6-4362-93f9-35c1db222fed', 'd20ce897-115f-473b-b250-25ed86e1d7d8', 'fc45a042-3907-4e08-88b6-769c73baa882', '7381c861-81c0-4161-a9b2-9c538d1d8e85'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:47 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:08:47 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:48 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.480s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:48 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:08:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Deleted volume successfully.
Feb 27 02:08:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b0b943b8-2362-42d1-aa92-b075eb98719d tempest-VolumesGetTest-977632775 None] Lock "cinder-015be97a-e5be-4751-80b9-1d6de69178b1-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (99b5c4d8-7cd0-4167-8e6b-78e4aab845b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5a483a-36a1-45ff-8b0f-d93e2769ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5a483a-36a1-45ff-8b0f-d93e2769ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-464019439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6b9998-6338-4088-b0f3-4812c4307570,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:49Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca01e86e-c82c-412a-bc10-27174c48fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca01e86e-c82c-412a-bc10-27174c48fa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a831be2e-c372-4131-9295-a1f576c482dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.image.glance [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Creating Keystone auth plugin from conf {{(pid=83140) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a831be2e-c372-4131-9295-a1f576c482dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b6b9998-6338-4088-b0f3-4812c4307570', 'volume_name': 'volume-0b6b9998-6338-4088-b0f3-4812c4307570', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7591d32980>}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e4bf00-ce90-424b-b509-e18655b559ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e4bf00-ce90-424b-b509-e18655b559ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3556152f-1013-4e46-a601-a7a905441a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:49 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Volume 0b6b9998-6338-4088-b0f3-4812c4307570: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b6b9998-6338-4088-b0f3-4812c4307570', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7591d32980>}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Trying to clone 0b6b9998-6338-4088-b0f3-4812c4307570 from image 6dca12c4-e54e-4172-8642-cefd07ec0f99 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]). {{(pid=83140) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Feb 27 02:08:49 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Image download 20.69 MB at 20.69 MB/s
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d07aa5f-497a-4734-8671-8399442df918]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:49 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD
Feb 27 02:08:49 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:50 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD" returned: 0 in 0.477s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Temporary image 6dca12c4-e54e-4172-8642-cefd07ec0f99 is fetched for user 8275939743ea44829bf6a631ca0a895c. {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b2a859-b31e-4a4d-b410-049f4e9c9677]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:50 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD
Feb 27 02:08:50 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:50 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD" returned: 0 in 0.597s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-464019439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6b9998-6338-4088-b0f3-4812c4307570,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:49Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Creating volume 0b6b9998-6338-4088-b0f3-4812c4307570 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:50 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:50 devstack sudo[89192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 1073741824
Feb 27 02:08:50 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:51 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 1073741824" returned: 0 in 0.625s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:51 devstack sudo[89197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570
Feb 27 02:08:51 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:52 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570" returned: 0 in 0.447s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:52 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:52 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Attempting download of 6dca12c4-e54e-4172-8642-cefd07ec0f99 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}])) to volume 0b6b9998-6338-4088-b0f3-4812c4307570. {{(pid=83140) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Feb 27 02:08:52 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c3c76d-b7d2-4aa3-91e1-df097c73fa65]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_e6j1h5_g {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:52 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_e6j1h5_g
Feb 27 02:08:52 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:52 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_e6j1h5_g" returned: 0 in 0.580s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_e6j1h5_g {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:52 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_e6j1h5_g
Feb 27 02:08:52 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:53 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_e6j1h5_g" returned: 1 in 0.567s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dca12c4-e54e-4172-8642-cefd07ec0f99_e6j1h5_g' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:08:53 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2675ead6-4f87-4628-b93b-27b0e473ad0d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:53 devstack sudo[89209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD
Feb 27 02:08:53 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:53 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD" returned: 0 in 0.558s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:53 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] 6dca12c4-e54e-4172-8642-cefd07ec0f99 was qcow2, converting to raw {{(pid=83140) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Feb 27 02:08:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:53 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570
Feb 27 02:08:53 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:54 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570" returned: 0 in 0.974s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:54 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dca12c4-e54e-4172-8642-cefd07ec0f99_cyyxq9n6devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:08:54 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Converted 112.00 MB image at 112.00 MB/s
Feb 27 02:08:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:54 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 1G
Feb 27 02:08:54 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:55 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 1G" returned: 0 in 0.418s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:55 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac21f83-cd8e-46ec-ac82-0a50a412d5fb]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:55 devstack sudo[89253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570
Feb 27 02:08:55 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:55 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570" returned: 0 in 0.458s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:55 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570
Feb 27 02:08:55 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:56 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570" returned: 1 in 0.487s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Downloaded image 6dca12c4-e54e-4172-8642-cefd07ec0f99 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}])) to volume 0b6b9998-6338-4088-b0f3-4812c4307570 successfully. {{(pid=83140) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Temporary image 6dca12c4-e54e-4172-8642-cefd07ec0f99 for user 8275939743ea44829bf6a631ca0a895c is deleted. {{(pid=83140) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG cinder.volume.volume_utils [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Marking volume 0b6b9998-6338-4088-b0f3-4812c4307570 as bootable. {{(pid=83140) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Copying metadata from image 6dca12c4-e54e-4172-8642-cefd07ec0f99 to 0b6b9998-6338-4088-b0f3-4812c4307570. {{(pid=83140) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Creating volume glance metadata for volume 0b6b9998-6338-4088-b0f3-4812c4307570 backed by image 6dca12c4-e54e-4172-8642-cefd07ec0f99 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83140) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3556152f-1013-4e46-a601-a7a905441a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6b9998-6338-4088-b0f3-4812c4307570', 'volume_size': 1, 'image_id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dca12c4-e54e-4172-8642-cefd07ec0f99', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e555d1175bd647ef85ebef7ebb6c6fcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6dca12c4-e54e-4172-8642-cefd07ec0f99', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dca12c4-e54e-4172-8642-cefd07ec0f99/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7591d32980>}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273f9fbe-6a48-4b75-b280-83028490b8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Volume volume-0b6b9998-6338-4088-b0f3-4812c4307570 (0b6b9998-6338-4088-b0f3-4812c4307570): created successfully
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273f9fbe-6a48-4b75-b280-83028490b8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (99b5c4d8-7cd0-4167-8e6b-78e4aab845b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:56 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-170f2f22-3e65-4a29-acc3-177caffa744d tempest-VolumesGetTest-977632775 None] Created volume successfully.
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (6bf055fb-57de-4a33-9c1e-1b85183c4a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe020a9-867e-4415-9959-73619706f388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe020a9-867e-4415-9959-73619706f388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-610428505',display_name='tempest-VolumesGetTest-Volume-1645876192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18da057-b7a4-4aec-8c5e-6232a8c9fb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:57Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0b99e5-5aa8-4f4a-9ab8-af3c7d87c3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0b99e5-5aa8-4f4a-9ab8-af3c7d87c3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399a6a5e-176f-4fbe-b74d-a919ce28ca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399a6a5e-176f-4fbe-b74d-a919ce28ca5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18da057-b7a4-4aec-8c5e-6232a8c9fb1f', 'volume_name': 'volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefa018f-2de9-4a37-9252-fc82f781819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefa018f-2de9-4a37-9252-fc82f781819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c07590-2428-4171-8ceb-ac11fef5ef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Volume d18da057-b7a4-4aec-8c5e-6232a8c9fb1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f', 'volume_size': 1}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:08:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-610428505',display_name='tempest-VolumesGetTest-Volume-1645876192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18da057-b7a4-4aec-8c5e-6232a8c9fb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8df7c124414a37a963bc1ae96f8024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:57Z,use_quota=True,user_id='8275939743ea44829bf6a631ca0a895c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Creating volume d18da057-b7a4-4aec-8c5e-6232a8c9fb1f {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:08:57 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:57 devstack sudo[89264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f 1073741824
Feb 27 02:08:57 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:57 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f 1073741824" returned: 0 in 0.554s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:57 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f
Feb 27 02:08:57 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:08:58 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Feb 27 02:08:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f" returned: 0 in 0.442s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:08:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:08:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:08:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c07590-2428-4171-8ceb-ac11fef5ef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9f88f5-d4e6-4097-a08c-7a9329eaa96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:08:58 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Volume volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f (d18da057-b7a4-4aec-8c5e-6232a8c9fb1f): created successfully
Feb 27 02:08:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9f88f5-d4e6-4097-a08c-7a9329eaa96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:08:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Flow 'volume_create_manager' (6bf055fb-57de-4a33-9c1e-1b85183c4a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:08:58 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b88bdc37-b48e-425c-b3e7-7872508190cd tempest-VolumesGetTest-977632775 None] Created volume successfully.
Feb 27 02:08:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Lock "cinder-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-quobyte-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:08:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:08:59 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80a58b4-033e-4926-949c-01e590420df2]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:08:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:08:59 devstack sudo[89302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f
Feb 27 02:08:59 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:00 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f" returned: 0 in 0.552s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:00 devstack sudo[89307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f
Feb 27 02:09:00 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:00 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f" returned: 0 in 0.435s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f" released by "delete_volume" :: held 1.033s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Created reservations ['e8053854-4922-448f-9d1c-06467aa831b6', 'af3bee1a-19ec-4fc3-9ca1-ab36e56ce159', '22caf5d4-9952-42a1-b929-19a15ac6e826', '5764a6a0-28f3-4bf1-84aa-09e543f195cb'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:00 devstack sudo[89310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:00 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:01 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.515s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:01 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:01 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Deleted volume successfully.
Feb 27 02:09:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b5f15a3b-244f-4fd8-8a90-8ae255fc04dd tempest-VolumesGetTest-977632775 None] Lock "cinder-d18da057-b7a4-4aec-8c5e-6232a8c9fb1f-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-0b6b9998-6338-4088-b0f3-4812c4307570-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Lock "cinder-0b6b9998-6338-4088-b0f3-4812c4307570-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Acquiring lock "cinder-quobyte-0b6b9998-6338-4088-b0f3-4812c4307570" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-0b6b9998-6338-4088-b0f3-4812c4307570" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:01 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a72325a-f7b2-4f78-8570-d0e66c48b760]: (4, 'raw') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:02 devstack sudo[89313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570
Feb 27 02:09:02 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:02 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570" returned: 0 in 0.734s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:02 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570
Feb 27 02:09:02 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:03 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570" returned: 1 in 0.623s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:03 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570
Feb 27 02:09:03 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:03 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0b6b9998-6338-4088-b0f3-4812c4307570" returned: 0 in 0.519s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Lock "cinder-quobyte-0b6b9998-6338-4088-b0f3-4812c4307570" released by "delete_volume" :: held 1.947s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Created reservations ['3037123c-67db-4f97-a3df-f0c3ee06cc64', '248b8e58-67b5-4e9c-b6af-191bc761b236', '3f985f30-a23a-4122-bd30-f4497e4612a6', '91dfd8f8-1f00-4bdb-80a0-e782043ec492'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:03 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:03 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:04 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.468s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:04 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:04 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Deleted volume successfully.
Feb 27 02:09:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-983b2b7b-730c-4a00-a825-1fbb17801e32 tempest-VolumesGetTest-977632775 None] Lock "cinder-0b6b9998-6338-4088-b0f3-4812c4307570-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Flow 'volume_create_manager' (a7ee6671-0367-4358-8466-fc36f1b9c2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc647cd-3701-4de1-8611-d4ea6bc29193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc647cd-3701-4de1-8611-d4ea6bc29193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1197558255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54322f50-7acb-470f-b097-a9f4925ef5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c2830420ebf417ab65de36578194b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:06Z,use_quota=True,user_id='002be1556da9451ab72b4b37ff285a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1beb4f6e-47e8-4274-9d63-93416300153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1beb4f6e-47e8-4274-9d63-93416300153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ec7ab7-84ee-4f3b-836e-12cb1306e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ec7ab7-84ee-4f3b-836e-12cb1306e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54322f50-7acb-470f-b097-a9f4925ef5d1', 'volume_name': 'volume-54322f50-7acb-470f-b097-a9f4925ef5d1', 'volume_size': 2}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fae52e6-a003-417b-b79c-6ea86130aa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fae52e6-a003-417b-b79c-6ea86130aa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7bbe41-74dd-4ac9-acff-7e49802e531f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:06 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Volume 54322f50-7acb-470f-b097-a9f4925ef5d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54322f50-7acb-470f-b097-a9f4925ef5d1', 'volume_size': 2}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1197558255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54322f50-7acb-470f-b097-a9f4925ef5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c2830420ebf417ab65de36578194b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:06Z,use_quota=True,user_id='002be1556da9451ab72b4b37ff285a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Creating volume 54322f50-7acb-470f-b097-a9f4925ef5d1 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:06 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1 2147483648 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:06 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1 2147483648
Feb 27 02:09:06 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:06 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1 2147483648" returned: 0 in 0.609s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:07 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1
Feb 27 02:09:07 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:07 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1" returned: 0 in 0.616s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7bbe41-74dd-4ac9-acff-7e49802e531f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54322f50-7acb-470f-b097-a9f4925ef5d1', 'volume_size': 2}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2955a9-90a3-4d67-be51-8279488b6be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:07 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Volume volume-54322f50-7acb-470f-b097-a9f4925ef5d1 (54322f50-7acb-470f-b097-a9f4925ef5d1): created successfully
Feb 27 02:09:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2955a9-90a3-4d67-be51-8279488b6be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:07 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Flow 'volume_create_manager' (a7ee6671-0367-4358-8466-fc36f1b9c2b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-27c21be8-9036-4d9c-ae77-1dc4374b5a34 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Created volume successfully.
Feb 27 02:09:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:08 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Creating offline snapshot 77a37f9a-bbc2-4e00-8383-31a1802c35e0 of volume 54322f50-7acb-470f-b097-a9f4925ef5d1 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:09:08 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c84df03-3d6b-4ea1-9b7f-e7d21b4e7a15]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:08 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1
Feb 27 02:09:08 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:09 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1" returned: 0 in 0.625s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 2G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:09 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 2G
Feb 27 02:09:09 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:09 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 2G" returned: 0 in 0.522s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54322f50-7acb-470f-b097-a9f4925ef5d1 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:09 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54322f50-7acb-470f-b097-a9f4925ef5d1 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0
Feb 27 02:09:09 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:10 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54322f50-7acb-470f-b097-a9f4925ef5d1 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0" returned: 0 in 0.506s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:10 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 is being set with open permissions: ugo+rw
Feb 27 02:09:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:10 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0
Feb 27 02:09:10 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:10 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0" returned: 0 in 0.511s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:10 devstack sudo[89383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.info
Feb 27 02:09:10 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:11 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.info" returned: 0 in 0.477s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:11 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.info is being set with open permissions: ugo+rw
Feb 27 02:09:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:11 devstack sudo[89386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.info
Feb 27 02:09:11 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:11 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.info" returned: 0 in 0.472s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.184s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:11 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d6a51bf3-f916-48b8-af93-cddfa38aa2da tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Create snapshot completed successfully
Feb 27 02:09:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Acquiring lock "cinder-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Lock "cinder-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Acquiring lock "cinder-quobyte-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Lock "cinder-quobyte-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e4553-b62b-4c21-bd72-62fc2cc6f643]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:12 devstack sudo[89389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e
Feb 27 02:09:12 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:12 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e" returned: 0 in 0.500s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:12 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e
Feb 27 02:09:12 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Acquiring lock "cinder-77a37f9a-bbc2-4e00-8383-31a1802c35e0-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-77a37f9a-bbc2-4e00-8383-31a1802c35e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Acquiring lock "cinder-quobyte-54322f50-7acb-470f-b097-a9f4925ef5d1" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-quobyte-54322f50-7acb-470f-b097-a9f4925ef5d1" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Acquiring lock "cinder-quobyte-77a37f9a-bbc2-4e00-8383-31a1802c35e0" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-quobyte-77a37f9a-bbc2-4e00-8383-31a1802c35e0" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Deleting offline snapshot 77a37f9a-bbc2-4e00-8383-31a1802c35e0 of volume 54322f50-7acb-470f-b097-a9f4925ef5d1 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] snapshot_file for this snap is: volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7ee83a-7524-48d2-bd34-009ac6818ce4]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:12 devstack sudo[89397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0
Feb 27 02:09:12 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:13 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e" returned: 0 in 0.467s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Lock "cinder-quobyte-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e" released by "delete_volume" :: held 0.992s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Created reservations ['1fd7dde1-3e9d-41c5-b9a7-18e920b28617', 'f447ef80-5956-475a-ad0b-eb7b8a271116', '73b1ada9-c7bb-4fe5-9634-06368e438c76', 'b439f4a6-15d3-44c6-914b-f185a4c0e67a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:13 devstack sudo[89400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:13 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:13 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0" returned: 0 in 0.540s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54322f50-7acb-470f-b097-a9f4925ef5d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc19cc44-3f96-4b5b-a055-31f43bd74f7d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:13 devstack sudo[89405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1
Feb 27 02:09:13 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:13 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.446s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:13 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Deleted volume successfully.
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4bc720cc-f733-455c-8299-7739f2fe483c tempest-VolumesNegativeTest-2049163706 None] Lock "cinder-d485ddd9-df1b-4bfb-a32e-8b6959b6a61e-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:13 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1" returned: 0 in 0.534s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:14 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0
Feb 27 02:09:14 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:14 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0" returned: 0 in 0.539s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:14 devstack sudo[89416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0
Feb 27 02:09:14 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:14 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1.77a37f9a-bbc2-4e00-8383-31a1802c35e0" returned: 0 in 0.469s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-quobyte-77a37f9a-bbc2-4e00-8383-31a1802c35e0" released by "_delete_snapshot" :: held 2.150s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-quobyte-54322f50-7acb-470f-b097-a9f4925ef5d1" released by "delete_snapshot" :: held 2.167s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:15 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Created reservations ['cafb8e30-5b12-4535-b37e-89844f75d6f9', '259fa3c2-3964-4152-bc38-592f2995ed54', '0304a483-6c33-41f3-9ac9-56dc74bd262f', '0c80bc02-03f5-42bf-8ff4-586c8686717d'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:15 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Delete snapshot completed successfully.
Feb 27 02:09:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-f5ed1c58-562c-46ec-bd0d-f1b1e485260d tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-77a37f9a-bbc2-4e00-8383-31a1802c35e0-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Acquiring lock "cinder-54322f50-7acb-470f-b097-a9f4925ef5d1-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-54322f50-7acb-470f-b097-a9f4925ef5d1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Acquiring lock "cinder-quobyte-54322f50-7acb-470f-b097-a9f4925ef5d1" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-quobyte-54322f50-7acb-470f-b097-a9f4925ef5d1" acquired by "delete_volume" :: waited 0.020s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:16 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcaf6f2-d639-4455-944a-3c542cfc5301]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:16 devstack sudo[89420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1
Feb 27 02:09:16 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:16 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1" returned: 0 in 0.641s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:16 devstack sudo[89425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1
Feb 27 02:09:16 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:17 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-54322f50-7acb-470f-b097-a9f4925ef5d1" returned: 0 in 0.539s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-quobyte-54322f50-7acb-470f-b097-a9f4925ef5d1" released by "delete_volume" :: held 1.236s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Created reservations ['ca45d2b4-8cb4-4a62-9187-c06fca064980', 'bef3b159-3513-4d84-83ba-675600a16664', '31716170-2c79-44ba-bcce-60a4aaf20645', 'bacd795e-6fb2-42ee-a828-7e1ba5cdd27a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:17 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:17 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:17 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.505s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:18 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:18 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Deleted volume successfully.
Feb 27 02:09:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-064aad3b-fc38-4215-b3f8-fae22ff11ee9 tempest-VolumesSnapshotNegativeTestJSON-563345446 None] Lock "cinder-54322f50-7acb-470f-b097-a9f4925ef5d1-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (e4ffae3b-c8f6-492b-b433-b70ceb87c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70d03d0-095c-47de-a982-87fe1d24ea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70d03d0-095c-47de-a982-87fe1d24ea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1419418515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467b3fde-41d2-4c7a-8ff4-6897fd7b11d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:20Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e06401-e21f-4183-abb8-1aaa7b68b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e06401-e21f-4183-abb8-1aaa7b68b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4842a2ee-dd00-46b7-abb8-f42b141c9d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4842a2ee-dd00-46b7-abb8-f42b141c9d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467b3fde-41d2-4c7a-8ff4-6897fd7b11d7', 'volume_name': 'volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8719f8-9623-4b0b-aa5f-ed39e68a265f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8719f8-9623-4b0b-aa5f-ed39e68a265f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16496885-953d-43f3-a40b-301cd623ae28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:20 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume 467b3fde-41d2-4c7a-8ff4-6897fd7b11d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7', 'volume_size': 1}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1419418515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467b3fde-41d2-4c7a-8ff4-6897fd7b11d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:20Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Creating volume 467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:20 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:20 devstack sudo[89431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 1073741824
Feb 27 02:09:20 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:21 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 1073741824" returned: 0 in 0.598s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:21 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7
Feb 27 02:09:21 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:21 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" returned: 0 in 0.521s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16496885-953d-43f3-a40b-301cd623ae28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e09ca8-3536-4c4c-a13e-8a68e63a7ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:21 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 (467b3fde-41d2-4c7a-8ff4-6897fd7b11d7): created successfully
Feb 27 02:09:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e09ca8-3536-4c4c-a13e-8a68e63a7ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (e4ffae3b-c8f6-492b-b433-b70ceb87c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:21 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8f4b825d-2b63-4df1-8ce4-003fd5b1806a tempest-CreateVolumesFromSnapshotTest-592859211 None] Created volume successfully.
Feb 27 02:09:22 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=117,cinder:SELECT=87,cinder:INSERT=39,cinder:DELETE=7 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:09:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Creating offline snapshot 4f4aaa76-c82a-4195-9acd-fcc52b9ae54c of volume 467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:09:22 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c841228f-eebe-43e7-a72c-19c37501f1d3]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:22 devstack sudo[89440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7
Feb 27 02:09:22 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (c91bdbd0-1780-4b41-b7af-84735e263a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b835b800-9be2-49c4-ad92-5f8e61af8031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b835b800-9be2-49c4-ad92-5f8e61af8031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1846444200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f328460-3696-4ef4-aaa8-d81ba2c33207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12dc1e1b6a8e445c88d15a42341ee359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:23Z,use_quota=True,user_id='8c9e5196d4bb45ed8c3fe2f7879cc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff475b8-d365-4574-87a2-7a5a0bc00793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff475b8-d365-4574-87a2-7a5a0bc00793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccb3f70-125f-4772-93e8-5336828a64dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccb3f70-125f-4772-93e8-5336828a64dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f328460-3696-4ef4-aaa8-d81ba2c33207', 'volume_name': 'volume-5f328460-3696-4ef4-aaa8-d81ba2c33207', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc155ee0-7117-4fe6-8457-84bbd62eac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc155ee0-7117-4fe6-8457-84bbd62eac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b2a015-1133-454b-b790-64fb1906e619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:23 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Volume 5f328460-3696-4ef4-aaa8-d81ba2c33207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f328460-3696-4ef4-aaa8-d81ba2c33207', 'volume_size': 1}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:23 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" returned: 0 in 0.519s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:23 devstack sudo[89445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c 1G
Feb 27 02:09:23 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:23 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c 1G" returned: 0 in 0.476s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:23 devstack sudo[89450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c
Feb 27 02:09:23 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:24 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c" returned: 0 in 0.435s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:24 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c is being set with open permissions: ugo+rw
Feb 27 02:09:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:24 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c
Feb 27 02:09:24 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:24 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c" returned: 0 in 0.475s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:24 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.info
Feb 27 02:09:24 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:25 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.info" returned: 0 in 0.476s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:25 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.info is being set with open permissions: ugo+rw
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:25 devstack sudo[89461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.info
Feb 27 02:09:25 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:25 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.info" returned: 0 in 0.432s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.640s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1846444200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f328460-3696-4ef4-aaa8-d81ba2c33207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12dc1e1b6a8e445c88d15a42341ee359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:23Z,use_quota=True,user_id='8c9e5196d4bb45ed8c3fe2f7879cc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Creating volume 5f328460-3696-4ef4-aaa8-d81ba2c33207 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:25 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:25 devstack sudo[89464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 1073741824
Feb 27 02:09:25 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:25 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-05f17bf2-c924-46f5-9438-0af044798284 tempest-CreateVolumesFromSnapshotTest-592859211 None] Create snapshot completed successfully
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (696a99e2-02d2-40c6-81f4-8832c6b07c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db25f7ab-bf95-4129-be41-37e7df1d93d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db25f7ab-bf95-4129-be41-37e7df1d93d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131101093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19479869-5267-45c4-b532-2cb37766cd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:26Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dad67ab-061f-4f9e-a023-05e6c92c8480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dad67ab-061f-4f9e-a023-05e6c92c8480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac53c791-0b5e-4bce-9566-66f860f5ce18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac53c791-0b5e-4bce-9566-66f860f5ce18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19479869-5267-45c4-b532-2cb37766cd9c', 'volume_name': 'volume-19479869-5267-45c4-b532-2cb37766cd9c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a3c7ae-e503-4417-9af5-d6fbb99bd155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a3c7ae-e503-4417-9af5-d6fbb99bd155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d4b55a-5de2-4ba1-97b5-a57f2a86233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume 19479869-5267-45c4-b532-2cb37766cd9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19479869-5267-45c4-b532-2cb37766cd9c', 'volume_size': 1}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:26 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 1073741824" returned: 0 in 0.606s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:26 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207
Feb 27 02:09:26 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (fd253a9a-5d41-4a12-9620-f5f2b3a5e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb76706-3604-4cd2-8f8a-36a644e17919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb76706-3604-4cd2-8f8a-36a644e17919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-337315446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f68b453-9726-4bc7-9e7e-da31dd65445e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:26Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee6745a-cbd0-4cd3-a5bd-a7f8634a613f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee6745a-cbd0-4cd3-a5bd-a7f8634a613f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c60cb9-c0a0-42c1-9216-9202c24233d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c60cb9-c0a0-42c1-9216-9202c24233d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f68b453-9726-4bc7-9e7e-da31dd65445e', 'volume_name': 'volume-0f68b453-9726-4bc7-9e7e-da31dd65445e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ad1691-088c-4d03-871f-27677776ccf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ad1691-088c-4d03-871f-27677776ccf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764e34c2-034a-47e3-987e-ab80e7c7dbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume 0f68b453-9726-4bc7-9e7e-da31dd65445e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f68b453-9726-4bc7-9e7e-da31dd65445e', 'volume_size': 1}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (9b84774f-01ac-4248-aec0-a3e3b4956d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fa1de8-eade-4e29-a369-7cc46a631bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fa1de8-eade-4e29-a369-7cc46a631bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369924546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad77de8e-3fa4-4a6d-a844-48ca5293d27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a42857-678c-4fb7-a6d7-0a3e1ed23478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a42857-678c-4fb7-a6d7-0a3e1ed23478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9ddbf6-45d1-497b-a55a-8227e38ebe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9ddbf6-45d1-497b-a55a-8227e38ebe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad77de8e-3fa4-4a6d-a844-48ca5293d27e', 'volume_name': 'volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81a699f-388c-45e2-b0a0-fc823c504325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81a699f-388c-45e2-b0a0-fc823c504325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2030a5f-bdbb-46d4-96b3-2fd2f6f1a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume ad77de8e-3fa4-4a6d-a844-48ca5293d27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e', 'volume_size': 1}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:26 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207" returned: 0 in 0.500s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131101093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19479869-5267-45c4-b532-2cb37766cd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:26Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Creating volume 19479869-5267-45c4-b532-2cb37766cd9c {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:26 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:26 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c 1073741824
Feb 27 02:09:26 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b2a015-1133-454b-b790-64fb1906e619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f328460-3696-4ef4-aaa8-d81ba2c33207', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ed3393-6d03-4167-972d-9331f71c3e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:26 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Volume volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 (5f328460-3696-4ef4-aaa8-d81ba2c33207): created successfully
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ed3393-6d03-4167-972d-9331f71c3e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (c91bdbd0-1780-4b41-b7af-84735e263a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (37723948-2b7a-4ef9-bcf2-8126077b0832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3bd498-3f20-43d5-87cf-584d3ad5356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b81ce55d-a6bc-4277-804b-f101c03fb76c tempest-VolumesSnapshotTestJSON-817714047 None] Created volume successfully.
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3bd498-3f20-43d5-87cf-584d3ad5356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1772802083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4899f86-5773-4ab3-88c4-1b1bcdce238c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeef212-96b5-42c1-b8b4-e83330efee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeef212-96b5-42c1-b8b4-e83330efee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00df020f-dece-4f63-82ff-a554a77cb5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00df020f-dece-4f63-82ff-a554a77cb5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4899f86-5773-4ab3-88c4-1b1bcdce238c', 'volume_name': 'volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd84a55f-0bb1-46cc-82a3-684aa4dc3883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd84a55f-0bb1-46cc-82a3-684aa4dc3883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aeafc45-0f78-4bb4-b38b-31067d3df15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume c4899f86-5773-4ab3-88c4-1b1bcdce238c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c', 'volume_size': 1}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (d9cc3ef6-ded3-4c94-bccf-97d437fbf640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0de17c3-8f4f-486e-9c4f-ffea079dff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0de17c3-8f4f-486e-9c4f-ffea079dff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-284673232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b6930f-c2c8-48c4-ace8-10c3807e237e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469960d7-b660-499a-9569-060a52f5e2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469960d7-b660-499a-9569-060a52f5e2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ae5f42-4664-4c91-bb96-893db6251245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ae5f42-4664-4c91-bb96-893db6251245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b6930f-c2c8-48c4-ace8-10c3807e237e', 'volume_name': 'volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48703e34-b0d2-48db-9e9d-0900312a13de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48703e34-b0d2-48db-9e9d-0900312a13de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83612cf8-a343-4f2b-9c44-5d3c22056f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:27 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume a8b6930f-c2c8-48c4-ace8-10c3807e237e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e', 'volume_size': 1}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:27 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c 1073741824" returned: 0 in 0.663s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:27 devstack sudo[89477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c
Feb 27 02:09:27 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:27 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c" returned: 0 in 0.395s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.440s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-337315446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f68b453-9726-4bc7-9e7e-da31dd65445e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:26Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Creating volume 0f68b453-9726-4bc7-9e7e-da31dd65445e {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:28 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d4b55a-5de2-4ba1-97b5-a57f2a86233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19479869-5267-45c4-b532-2cb37766cd9c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:28 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e 1073741824
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc68b6a-6148-4e02-8f82-1bdf3083db53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:28 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:28 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume volume-19479869-5267-45c4-b532-2cb37766cd9c (19479869-5267-45c4-b532-2cb37766cd9c): created successfully
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc68b6a-6148-4e02-8f82-1bdf3083db53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (696a99e2-02d2-40c6-81f4-8832c6b07c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:28 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0c3a5871-9cec-4035-9c7f-8458c27727e8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Created volume successfully.
Feb 27 02:09:28 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e 1073741824" returned: 0 in 0.518s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:28 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e
Feb 27 02:09:28 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:28 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e" returned: 0 in 0.419s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.181s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1369924546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad77de8e-3fa4-4a6d-a844-48ca5293d27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Creating volume ad77de8e-3fa4-4a6d-a844-48ca5293d27e {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:28 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764e34c2-034a-47e3-987e-ab80e7c7dbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f68b453-9726-4bc7-9e7e-da31dd65445e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:29 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e 1073741824
Feb 27 02:09:29 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47b2c30-92d8-49cc-b893-8729db960d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:29 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume volume-0f68b453-9726-4bc7-9e7e-da31dd65445e (0f68b453-9726-4bc7-9e7e-da31dd65445e): created successfully
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47b2c30-92d8-49cc-b893-8729db960d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (fd253a9a-5d41-4a12-9620-f5f2b3a5e800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:29 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ec501f2a-aaa0-45f1-91f9-ef8578828e19 tempest-CreateVolumesFromSnapshotTest-592859211 None] Created volume successfully.
Feb 27 02:09:29 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e 1073741824" returned: 0 in 0.494s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:29 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e
Feb 27 02:09:29 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:29 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e" returned: 0 in 0.391s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.832s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1772802083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4899f86-5773-4ab3-88c4-1b1bcdce238c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Creating volume c4899f86-5773-4ab3-88c4-1b1bcdce238c {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:29 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2030a5f-bdbb-46d4-96b3-2fd2f6f1a769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:29 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c 1073741824
Feb 27 02:09:29 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8998d52d-bced-482e-998c-867f6344b9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:29 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e (ad77de8e-3fa4-4a6d-a844-48ca5293d27e): created successfully
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8998d52d-bced-482e-998c-867f6344b9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (9b84774f-01ac-4248-aec0-a3e3b4956d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:29 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-045cb815-58aa-401a-ae7a-bdd8ba156977 tempest-CreateVolumesFromSnapshotTest-592859211 None] Created volume successfully.
Feb 27 02:09:30 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c 1073741824" returned: 0 in 0.460s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:30 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c
Feb 27 02:09:30 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:30 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c" returned: 0 in 0.386s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.435s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-284673232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b6930f-c2c8-48c4-ace8-10c3807e237e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de1f13556844e2faba49cc09a447fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='4146f264baa6448ab9dac3d0f04936df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Creating volume a8b6930f-c2c8-48c4-ace8-10c3807e237e {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:30 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aeafc45-0f78-4bb4-b38b-31067d3df15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:30 devstack sudo[89504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e 1073741824
Feb 27 02:09:30 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33dc9487-dfe4-401a-a2b9-1d220d3aea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:30 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c (c4899f86-5773-4ab3-88c4-1b1bcdce238c): created successfully
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33dc9487-dfe4-401a-a2b9-1d220d3aea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (37723948-2b7a-4ef9-bcf2-8126077b0832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:30 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=115,cinder:DELETE=15,cinder:INSERT=27,cinder:SELECT=85 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:09:30 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d14f42d2-e70a-4469-a637-e9b409eeae4a tempest-CreateVolumesFromSnapshotTest-592859211 None] Created volume successfully.
Feb 27 02:09:31 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e 1073741824" returned: 0 in 0.502s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:31 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e
Feb 27 02:09:31 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:31 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e" returned: 0 in 0.431s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.217s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83612cf8-a343-4f2b-9c44-5d3c22056f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad99ef3-ba95-4b23-90ad-f78b8f8a0776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Creating offline snapshot 4ea5f976-abdd-4217-a6a8-64f95fc0897a of volume 5f328460-3696-4ef4-aaa8-d81ba2c33207 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:09:31 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Volume volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e (a8b6930f-c2c8-48c4-ace8-10c3807e237e): created successfully
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad99ef3-ba95-4b23-90ad-f78b8f8a0776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Flow 'volume_create_manager' (d9cc3ef6-ded3-4c94-bccf-97d437fbf640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf438ccc-a4f5-4fdc-86af-76239f9f00fc]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:31 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0c4c029b-fa6d-4339-90e7-0b9546df06fe tempest-CreateVolumesFromSnapshotTest-592859211 None] Created volume successfully.
Feb 27 02:09:31 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207
Feb 27 02:09:31 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:32 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207" returned: 0 in 0.485s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:32 devstack sudo[89517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a 1G
Feb 27 02:09:32 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:32 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:32 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-a8b6930f-c2c8-48c4-ace8-10c3807e237e-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-a8b6930f-c2c8-48c4-ace8-10c3807e237e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-quobyte-a8b6930f-c2c8-48c4-ace8-10c3807e237e" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-a8b6930f-c2c8-48c4-ace8-10c3807e237e" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc90972d-8359-422b-9c7a-bbc2fff36ee9]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:32 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a 1G" returned: 0 in 0.542s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:32 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a
Feb 27 02:09:32 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:32 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e
Feb 27 02:09:32 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:33 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.521s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:33 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a" returned: 0 in 0.484s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:33 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a is being set with open permissions: ugo+rw
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:33 devstack sudo[89536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a
Feb 27 02:09:33 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:33 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e" returned: 0 in 0.566s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:33 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e
Feb 27 02:09:33 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:33 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a" returned: 0 in 0.421s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:33 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-a8b6930f-c2c8-48c4-ace8-10c3807e237e" returned: 0 in 0.406s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:33 devstack sudo[89542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.info
Feb 27 02:09:33 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-a8b6930f-c2c8-48c4-ace8-10c3807e237e" released by "delete_volume" :: held 1.001s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Created reservations ['d67d893c-28e8-4c5f-b465-a7c636d0b0b1', 'd508eea9-832f-492f-bc6b-6cf236427610', 'dbf5ef60-0254-4da0-bea4-10bc50a99932', '9255e430-84eb-4f31-b69d-87f8262b5b19'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:33 devstack sudo[89544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:33 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:34 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.info" returned: 0 in 0.401s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:34 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.info is being set with open permissions: ugo+rw
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:34 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.info
Feb 27 02:09:34 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:34 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.451s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:34 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Deleted volume successfully.
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01663cee-47a5-4a15-ab79-50b279880703 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-a8b6930f-c2c8-48c4-ace8-10c3807e237e-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:34 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.info" returned: 0 in 0.454s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:34 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8c3a2679-0179-4baa-862c-0bb50a575089 tempest-VolumesSnapshotTestJSON-817714047 None] Create snapshot completed successfully
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-4ea5f976-abdd-4217-a6a8-64f95fc0897a-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-4ea5f976-abdd-4217-a6a8-64f95fc0897a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-c4899f86-5773-4ab3-88c4-1b1bcdce238c-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-c4899f86-5773-4ab3-88c4-1b1bcdce238c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-5f328460-3696-4ef4-aaa8-d81ba2c33207" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-quobyte-c4899f86-5773-4ab3-88c4-1b1bcdce238c" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-5f328460-3696-4ef4-aaa8-d81ba2c33207" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-4ea5f976-abdd-4217-a6a8-64f95fc0897a" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-c4899f86-5773-4ab3-88c4-1b1bcdce238c" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-4ea5f976-abdd-4217-a6a8-64f95fc0897a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Deleting offline snapshot 4ea5f976-abdd-4217-a6a8-64f95fc0897a of volume 5f328460-3696-4ef4-aaa8-d81ba2c33207 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] snapshot_file for this snap is: volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ab69cb-0f44-4544-8c6b-9bc6d59146a7]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e4097b-716a-431f-85cf-c7d069a280c0]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:35 devstack sudo[89552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c
Feb 27 02:09:35 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:35 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a
Feb 27 02:09:35 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:35 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c" returned: 0 in 0.495s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:35 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a" returned: 0 in 0.506s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f328460-3696-4ef4-aaa8-d81ba2c33207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:09:35 devstack sudo[89562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c
Feb 27 02:09:35 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba2334e-a2a0-49b2-ace6-83fc307ac634]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:35 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207
Feb 27 02:09:35 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:35 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c4899f86-5773-4ab3-88c4-1b1bcdce238c" returned: 0 in 0.399s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-c4899f86-5773-4ab3-88c4-1b1bcdce238c" released by "delete_volume" :: held 0.924s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Created reservations ['616fa114-de79-442a-8692-cc1fa2a65b2c', '1f76317b-1a24-4392-841b-77fa712ae6e8', '6358908f-423e-43bd-bc97-7484e46dee35', 'cb73c9e1-37c4-4067-98b4-d813a2588a9f'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:35 devstack sudo[89569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:35 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-ad77de8e-3fa4-4a6d-a844-48ca5293d27e-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-ad77de8e-3fa4-4a6d-a844-48ca5293d27e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-quobyte-ad77de8e-3fa4-4a6d-a844-48ca5293d27e" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-ad77de8e-3fa4-4a6d-a844-48ca5293d27e" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9425f9-42dd-40cd-8955-4826d0e3f243]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:36 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207" returned: 0 in 0.589s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:36 devstack sudo[89573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a
Feb 27 02:09:36 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:36 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e
Feb 27 02:09:36 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:36 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.459s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:36 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Deleted volume successfully.
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-138237ca-0ef4-4462-9cba-53d0557c4643 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-c4899f86-5773-4ab3-88c4-1b1bcdce238c-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:36 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a" returned: 0 in 0.477s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:36 devstack sudo[89583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a
Feb 27 02:09:36 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:36 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e" returned: 0 in 0.536s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:36 devstack sudo[89585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e
Feb 27 02:09:36 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:36 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207.4ea5f976-abdd-4217-a6a8-64f95fc0897a" returned: 0 in 0.419s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-4ea5f976-abdd-4217-a6a8-64f95fc0897a" released by "_delete_snapshot" :: held 2.064s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-5f328460-3696-4ef4-aaa8-d81ba2c33207" released by "delete_snapshot" :: held 2.083s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:37 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-ad77de8e-3fa4-4a6d-a844-48ca5293d27e" returned: 0 in 0.418s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-ad77de8e-3fa4-4a6d-a844-48ca5293d27e" released by "delete_volume" :: held 0.978s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Created reservations ['7d91a3dd-a7dc-4520-86c3-ef4d7e83a4cd', 'e1ba67c5-7fb7-4945-8b43-913b317060a7', 'cac31ad8-aeaf-4142-aad9-c893ce92b069', 'f504203b-5845-48e5-ae27-dde38395f4ac'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Created reservations ['043aef4b-0e66-4d55-818c-b49bc8f4431b', 'ef4deb02-5b07-4d2a-947c-dffd77307987', 'c6ee8b5f-055f-4cf6-b799-51e882b617b8', 'd9a717dd-8a21-446a-97b8-cc26db541309'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:37 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Delete snapshot completed successfully.
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c51e4c75-590f-4e71-a64f-5380a398beda tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-4ea5f976-abdd-4217-a6a8-64f95fc0897a-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:37 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:37 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:37 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.401s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:37 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Deleted volume successfully.
Feb 27 02:09:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-142dab05-824a-44a7-b17c-b82552fba2a8 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-ad77de8e-3fa4-4a6d-a844-48ca5293d27e-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-0f68b453-9726-4bc7-9e7e-da31dd65445e-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-0f68b453-9726-4bc7-9e7e-da31dd65445e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-quobyte-0f68b453-9726-4bc7-9e7e-da31dd65445e" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-0f68b453-9726-4bc7-9e7e-da31dd65445e" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99db1f7-5aa2-453d-bd1a-eb5fa78d64e7]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (a54bb0ba-3b21-4e01-b10d-89bd5c9ce340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b2a7b0-a0f9-4b39-8919-fa819751007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:38 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e
Feb 27 02:09:38 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b2a7b0-a0f9-4b39-8919-fa819751007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-850888981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1173133b-c822-4dd1-986e-45ea5cc96ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12dc1e1b6a8e445c88d15a42341ee359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:38Z,use_quota=True,user_id='8c9e5196d4bb45ed8c3fe2f7879cc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abb525d-86c0-4a60-bb8b-11aefddd58c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abb525d-86c0-4a60-bb8b-11aefddd58c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2b42a6-d523-48a6-87a9-c73a25d8d43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2b42a6-d523-48a6-87a9-c73a25d8d43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1173133b-c822-4dd1-986e-45ea5cc96ae8', 'volume_name': 'volume-1173133b-c822-4dd1-986e-45ea5cc96ae8', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8855dc2-ee9e-4312-a36f-100b42b45573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8855dc2-ee9e-4312-a36f-100b42b45573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fde7944-289b-443d-9659-2bed2ba445aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:38 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Volume 1173133b-c822-4dd1-986e-45ea5cc96ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1173133b-c822-4dd1-986e-45ea5cc96ae8', 'volume_size': 1}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-850888981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1173133b-c822-4dd1-986e-45ea5cc96ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12dc1e1b6a8e445c88d15a42341ee359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:38Z,use_quota=True,user_id='8c9e5196d4bb45ed8c3fe2f7879cc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Creating volume 1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:38 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:38 devstack sudo[89594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 1073741824
Feb 27 02:09:38 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:38 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e" returned: 0 in 0.491s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:38 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e
Feb 27 02:09:38 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:38 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 1073741824" returned: 0 in 0.505s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:38 devstack sudo[89604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8
Feb 27 02:09:38 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:39 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0f68b453-9726-4bc7-9e7e-da31dd65445e" returned: 0 in 0.439s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-0f68b453-9726-4bc7-9e7e-da31dd65445e" released by "delete_volume" :: held 0.974s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Created reservations ['6887924b-d2e8-49ff-b2ef-fbb658dd63f9', '01b87af5-b56f-4824-af3c-c54cc3b536bb', '796fc2ea-adaa-4ebd-86e5-df15068126e2', '4118052c-8810-4f7e-be16-0b098b41559b'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:39 devstack sudo[89608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:39 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-19479869-5267-45c4-b532-2cb37766cd9c-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-19479869-5267-45c4-b532-2cb37766cd9c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-quobyte-19479869-5267-45c4-b532-2cb37766cd9c" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-19479869-5267-45c4-b532-2cb37766cd9c" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:39 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8" returned: 0 in 0.499s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[23026332-f9ba-4f1c-ac08-3488a73c2d14]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fde7944-289b-443d-9659-2bed2ba445aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1173133b-c822-4dd1-986e-45ea5cc96ae8', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1aafc7-b693-4252-a4d4-2661af3a8d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:39 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Volume volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 (1173133b-c822-4dd1-986e-45ea5cc96ae8): created successfully
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1aafc7-b693-4252-a4d4-2661af3a8d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (a54bb0ba-3b21-4e01-b10d-89bd5c9ce340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:39 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-059c81ab-b3af-490c-94b2-15c8a2ba63e8 tempest-VolumesSnapshotTestJSON-817714047 None] Created volume successfully.
Feb 27 02:09:39 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c
Feb 27 02:09:39 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:39 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.469s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:39 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Deleted volume successfully.
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-155823c1-7a07-4a8f-861c-f223040a28c9 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-0f68b453-9726-4bc7-9e7e-da31dd65445e-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:39 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c" returned: 0 in 0.495s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:39 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c
Feb 27 02:09:39 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:40 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-19479869-5267-45c4-b532-2cb37766cd9c" returned: 0 in 0.406s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-19479869-5267-45c4-b532-2cb37766cd9c" released by "delete_volume" :: held 0.932s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Created reservations ['f60550e2-cb0d-4511-a7f2-c3b528769de1', '3d1d91ae-dce5-4654-a131-19aeb49b9573', '2faa4734-421c-4ad4-8805-59a449fead84', '94dfaf9d-9d11-4ec6-aa05-255b0cee2ab8'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:40 devstack sudo[89619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:40 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-4f4aaa76-c82a-4195-9acd-fcc52b9ae54c-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-4f4aaa76-c82a-4195-9acd-fcc52b9ae54c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-quobyte-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-quobyte-4f4aaa76-c82a-4195-9acd-fcc52b9ae54c" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-4f4aaa76-c82a-4195-9acd-fcc52b9ae54c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Deleting offline snapshot 4f4aaa76-c82a-4195-9acd-fcc52b9ae54c of volume 467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] snapshot_file for this snap is: volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fedf44e-88e1-45b1-be10-42894b96c3fc]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Creating offline snapshot 94267c5e-9fe2-4e75-8e8a-c8927e182a9d of volume 1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05e0e11-2a52-44e9-b493-ecad85c8d21d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:40 devstack sudo[89653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c
Feb 27 02:09:40 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:40 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8
Feb 27 02:09:40 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:41 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.525s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:41 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Deleted volume successfully.
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-bb03de1e-838b-4ace-b35b-cb7fe3ae8321 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-19479869-5267-45c4-b532-2cb37766cd9c-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:41 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c" returned: 0 in 0.545s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[07747a8c-16a9-49ee-94e4-8430d86a5855]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:41 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8" returned: 0 in 0.522s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:41 devstack sudo[89673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d 1G
Feb 27 02:09:41 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:41 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7
Feb 27 02:09:41 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:41 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" returned: 0 in 0.523s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:41 devstack sudo[89682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c
Feb 27 02:09:41 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:41 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d 1G" returned: 0 in 0.529s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:41 devstack sudo[89684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d
Feb 27 02:09:41 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:42 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c" returned: 0 in 0.472s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:42 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d" returned: 0 in 0.440s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:42 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d is being set with open permissions: ugo+rw
Feb 27 02:09:42 devstack sudo[89692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:42 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:42 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d
Feb 27 02:09:42 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:42 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7.4f4aaa76-c82a-4195-9acd-fcc52b9ae54c" returned: 0 in 0.425s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:42 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d" returned: 0 in 0.426s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-4f4aaa76-c82a-4195-9acd-fcc52b9ae54c" released by "_delete_snapshot" :: held 2.041s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" released by "delete_snapshot" :: held 2.056s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:42 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.info
Feb 27 02:09:42 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Created reservations ['6256e8ce-4707-462e-b9c4-c24204c72f49', '5346aee5-9998-4049-bdaa-211465310cfc', 'c5a885e1-431f-466a-aeda-b528fb3bf0a3', 'bafa9f82-fc83-4516-8701-bdd0d84ee424'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:42 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Delete snapshot completed successfully.
Feb 27 02:09:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-fea3bf7f-3c78-44ac-bb81-3a959cbca72c tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-4f4aaa76-c82a-4195-9acd-fcc52b9ae54c-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:43 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.info" returned: 0 in 0.422s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:43 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.info is being set with open permissions: ugo+rw
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:43 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.info
Feb 27 02:09:43 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:43 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.info" returned: 0 in 0.404s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.830s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:43 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-596ffa9b-3581-40a0-9da2-5ce795c5e6f2 tempest-VolumesSnapshotTestJSON-817714047 None] Create snapshot completed successfully
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "cinder-quobyte-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffc7758-94cf-4a55-9b06-e85074d94e94]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:43 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7
Feb 27 02:09:43 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (03a84da1-91c3-401a-a668-f47fd426bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf387fe7-9cce-44b9-aaa0-0bf6775bca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf387fe7-9cce-44b9-aaa0-0bf6775bca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1744611427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c272c82-bb25-4fe3-a580-ea44076055c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12dc1e1b6a8e445c88d15a42341ee359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=94267c5e-9fe2-4e75-8e8a-c8927e182a9d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:44Z,use_quota=True,user_id='8c9e5196d4bb45ed8c3fe2f7879cc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77a5936-2d00-4636-ae9b-98573d818af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77a5936-2d00-4636-ae9b-98573d818af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70373633-0de0-40df-9f91-834b34463a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70373633-0de0-40df-9f91-834b34463a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c272c82-bb25-4fe3-a580-ea44076055c4', 'volume_name': 'volume-1c272c82-bb25-4fe3-a580-ea44076055c4', 'volume_size': 2, 'snapshot_id': '94267c5e-9fe2-4e75-8e8a-c8927e182a9d'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be4a423-01c2-43bc-adeb-bb77baf0e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be4a423-01c2-43bc-adeb-bb77baf0e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e998095e-1962-4b2b-9e4e-ed4c818f7dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:44 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Volume 1c272c82-bb25-4fe3-a580-ea44076055c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c272c82-bb25-4fe3-a580-ea44076055c4', 'volume_size': 2, 'snapshot_id': '94267c5e-9fe2-4e75-8e8a-c8927e182a9d'}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-94267c5e-9fe2-4e75-8e8a-c8927e182a9d-1c272c82-bb25-4fe3-a580-ea44076055c4" by "_create_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-94267c5e-9fe2-4e75-8e8a-c8927e182a9d-1c272c82-bb25-4fe3-a580-ea44076055c4" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Creating volume 1c272c82-bb25-4fe3-a580-ea44076055c4 from snapshot 94267c5e-9fe2-4e75-8e8a-c8927e182a9d {{(pid=83140) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-1c272c82-bb25-4fe3-a580-ea44076055c4" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-1c272c82-bb25-4fe3-a580-ea44076055c4" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] snapshot: 94267c5e-9fe2-4e75-8e8a-c8927e182a9d, volume: 1c272c82-bb25-4fe3-a580-ea44076055c4,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1068823f-d090-4fdf-bac2-ab160663c9ef]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:44 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" returned: 0 in 0.554s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:44 devstack sudo[89710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d
Feb 27 02:09:44 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:44 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7
Feb 27 02:09:44 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:44 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d" returned: 0 in 0.498s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1173133b-c822-4dd1-986e-45ea5cc96ae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acf522b-5bf5-4766-a1f8-22888e0fb5d1]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:44 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" returned: 0 in 0.472s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-quobyte-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7" released by "delete_volume" :: held 1.058s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Created reservations ['918e5386-cdb9-442a-8a5a-6682d8d2fdeb', 'c388d48c-752d-45d8-af00-346916bde24a', '0fcacdb8-308c-419a-be2b-9c750e818984', 'ab91e666-acf1-4a9f-823d-a79bec6a361d'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:44 devstack sudo[89718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8
Feb 27 02:09:44 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:44 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:44 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:45 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8" returned: 0 in 0.502s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:45 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:09:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:45 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4
Feb 27 02:09:45 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:45 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.509s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:45 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:45 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Deleted volume successfully.
Feb 27 02:09:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5b9e8297-f633-4ddb-baed-b43d0ce36049 tempest-CreateVolumesFromSnapshotTest-592859211 None] Lock "cinder-467b3fde-41d2-4c7a-8ff4-6897fd7b11d7-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:47 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4" returned: 0 in 2.099s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:47 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[135fb33c-3f7a-4904-b337-4c253ced398d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:47 devstack sudo[89738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8
Feb 27 02:09:47 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:48 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8" returned: 0 in 0.672s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:09:48 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Converted 1024.00 MB image at 487.62 MB/s
Feb 27 02:09:48 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4 is being set with open permissions: ugo+rw
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:48 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4
Feb 27 02:09:48 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:48 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4" returned: 0 in 0.405s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-1c272c82-bb25-4fe3-a580-ea44076055c4" released by "_copy_volume_from_snapshot" :: held 4.245s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-94267c5e-9fe2-4e75-8e8a-c8927e182a9d-1c272c82-bb25-4fe3-a580-ea44076055c4" released by "_create_volume_from_snapshot" :: held 4.263s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.272s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e998095e-1962-4b2b-9e4e-ed4c818f7dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c272c82-bb25-4fe3-a580-ea44076055c4', 'volume_size': 2, 'snapshot_id': '94267c5e-9fe2-4e75-8e8a-c8927e182a9d'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fecb17-7c9b-46ac-a032-01ba508d7299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:48 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Volume volume-1c272c82-bb25-4fe3-a580-ea44076055c4 (1c272c82-bb25-4fe3-a580-ea44076055c4): created successfully
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fecb17-7c9b-46ac-a032-01ba508d7299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (03a84da1-91c3-401a-a668-f47fd426bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-712f0b8b-2b9c-46c2-ae66-f2910b36a4fc tempest-VolumesSnapshotTestJSON-817714047 None] Created volume successfully.
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-1c272c82-bb25-4fe3-a580-ea44076055c4-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-1c272c82-bb25-4fe3-a580-ea44076055c4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-1c272c82-bb25-4fe3-a580-ea44076055c4" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-1c272c82-bb25-4fe3-a580-ea44076055c4" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ba61df-a6ac-4548-90a4-06a5e76a95a5]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:48 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4
Feb 27 02:09:48 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:49 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4" returned: 0 in 0.473s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:49 devstack sudo[89752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4
Feb 27 02:09:49 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:49 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1c272c82-bb25-4fe3-a580-ea44076055c4" returned: 0 in 0.408s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-1c272c82-bb25-4fe3-a580-ea44076055c4" released by "delete_volume" :: held 0.906s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Created reservations ['42317106-d789-42b4-89eb-05e8b378dcc3', 'f0e76cc6-ceeb-422c-b5cd-badf6477e0ec', '94849d4b-7a97-4ed9-8e25-3e5db038fc4a', '8631b6e3-edaa-4fd5-8968-8a077ee3bdc2'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:49 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:49 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-94267c5e-9fe2-4e75-8e8a-c8927e182a9d-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-94267c5e-9fe2-4e75-8e8a-c8927e182a9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-1173133b-c822-4dd1-986e-45ea5cc96ae8" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-1173133b-c822-4dd1-986e-45ea5cc96ae8" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-94267c5e-9fe2-4e75-8e8a-c8927e182a9d" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-94267c5e-9fe2-4e75-8e8a-c8927e182a9d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Deleting offline snapshot 94267c5e-9fe2-4e75-8e8a-c8927e182a9d of volume 1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] snapshot_file for this snap is: volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2551c24a-3205-4b18-8b0a-f444815ce01b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:49 devstack sudo[89757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d
Feb 27 02:09:49 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:50 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.406s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:50 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:50 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Deleted volume successfully.
Feb 27 02:09:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0903923f-aec7-45e2-808e-57b2649ee828 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-1c272c82-bb25-4fe3-a580-ea44076055c4-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:50 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d" returned: 0 in 0.477s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1173133b-c822-4dd1-986e-45ea5cc96ae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:09:50 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c7edcf-d764-4f20-85f7-dee2c49a895b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:50 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8
Feb 27 02:09:50 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:50 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8" returned: 0 in 0.489s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:50 devstack sudo[89768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d
Feb 27 02:09:50 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:51 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d" returned: 0 in 0.481s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:51 devstack sudo[89773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d
Feb 27 02:09:51 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:51 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8.94267c5e-9fe2-4e75-8e8a-c8927e182a9d" returned: 0 in 0.416s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-94267c5e-9fe2-4e75-8e8a-c8927e182a9d" released by "_delete_snapshot" :: held 1.917s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-1173133b-c822-4dd1-986e-45ea5cc96ae8" released by "delete_snapshot" :: held 1.931s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:51 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Created reservations ['e6ef55a4-022c-4446-8d6e-ba2fb42df976', 'a8e4356a-98d3-406d-824c-69853bf4215f', '45f7ea6f-092e-4a46-973b-cf759adad6b9', '83afd32b-73a7-42fb-b9a2-bed74b7cc8bf'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Delete snapshot completed successfully.
Feb 27 02:09:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b2c928e5-1c0b-4151-9d82-ce5561613aa1 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-94267c5e-9fe2-4e75-8e8a-c8927e182a9d-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-1173133b-c822-4dd1-986e-45ea5cc96ae8-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-1173133b-c822-4dd1-986e-45ea5cc96ae8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-1173133b-c822-4dd1-986e-45ea5cc96ae8" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:09:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-1173133b-c822-4dd1-986e-45ea5cc96ae8" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:09:52 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c119cf84-1f57-4443-9af9-ce7a66dee2b1]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:52 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8
Feb 27 02:09:52 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:52 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8" returned: 0 in 0.519s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:52 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8
Feb 27 02:09:52 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:53 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-1173133b-c822-4dd1-986e-45ea5cc96ae8" returned: 0 in 0.426s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-1173133b-c822-4dd1-986e-45ea5cc96ae8" released by "delete_volume" :: held 0.975s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Created reservations ['5f2e37dd-e2b7-43c8-a6d5-9fe134a80928', 'bba9e68c-5d4b-40e7-a1c9-0c26bc82fe79', '3b5cb0e6-da58-491e-8fcd-d82f58f1eca9', '45324216-a97a-47eb-8592-5125adbde063'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:53 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:09:53 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:53 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.397s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:09:53 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Deleted volume successfully.
Feb 27 02:09:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-137eefc3-3746-4da2-ae60-2118fde3dc52 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-1173133b-c822-4dd1-986e-45ea5cc96ae8-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (7e194081-8ff1-4ed5-a8d0-8b41862ceae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c95cf1d-bdb0-411a-bd96-3fef20f46b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c95cf1d-bdb0-411a-bd96-3fef20f46b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1892547367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402550b4-0d04-40b0-8375-27c5020b9934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12dc1e1b6a8e445c88d15a42341ee359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:54Z,use_quota=True,user_id='8c9e5196d4bb45ed8c3fe2f7879cc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ded734-dde3-4fcb-b6b1-605a08e2ba25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ded734-dde3-4fcb-b6b1-605a08e2ba25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52648693-6e73-49b5-ad7d-5cfb8d35b368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52648693-6e73-49b5-ad7d-5cfb8d35b368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402550b4-0d04-40b0-8375-27c5020b9934', 'volume_name': 'volume-402550b4-0d04-40b0-8375-27c5020b9934', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e34160f-98ec-4fb0-9158-789995b31a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e34160f-98ec-4fb0-9158-789995b31a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ca3b2-0b72-4d6d-870c-a6e3262230c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:54 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Volume 402550b4-0d04-40b0-8375-27c5020b9934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402550b4-0d04-40b0-8375-27c5020b9934', 'volume_size': 1}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1892547367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402550b4-0d04-40b0-8375-27c5020b9934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12dc1e1b6a8e445c88d15a42341ee359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:54Z,use_quota=True,user_id='8c9e5196d4bb45ed8c3fe2f7879cc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Creating volume 402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:09:54 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:09:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:54 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 1073741824
Feb 27 02:09:54 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:55 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 1073741824" returned: 0 in 0.498s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:55 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934
Feb 27 02:09:55 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:55 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934" returned: 0 in 0.426s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:09:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ca3b2-0b72-4d6d-870c-a6e3262230c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402550b4-0d04-40b0-8375-27c5020b9934', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb576da-4731-4e39-a315-31a5715d1235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:09:55 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Volume volume-402550b4-0d04-40b0-8375-27c5020b9934 (402550b4-0d04-40b0-8375-27c5020b9934): created successfully
Feb 27 02:09:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb576da-4731-4e39-a315-31a5715d1235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:09:55 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (7e194081-8ff1-4ed5-a8d0-8b41862ceae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:09:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9fa0121c-3abd-4f29-b6e2-7587969ad095 tempest-VolumesSnapshotTestJSON-817714047 None] Created volume successfully.
Feb 27 02:09:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:09:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:09:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Creating offline snapshot 4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c of volume 402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:09:56 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[6617aeb5-78a8-42f7-91f5-da129688127c]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:09:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:56 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934
Feb 27 02:09:56 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:57 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934" returned: 0 in 0.483s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:57 devstack sudo[89803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c 1G
Feb 27 02:09:57 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:57 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c 1G" returned: 0 in 0.513s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-402550b4-0d04-40b0-8375-27c5020b9934 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:57 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-402550b4-0d04-40b0-8375-27c5020b9934 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c
Feb 27 02:09:57 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:58 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-402550b4-0d04-40b0-8375-27c5020b9934 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c" returned: 0 in 0.439s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:58 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c is being set with open permissions: ugo+rw
Feb 27 02:09:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:58 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c
Feb 27 02:09:58 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:58 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c" returned: 0 in 0.393s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:58 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.info
Feb 27 02:09:58 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:58 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.info" returned: 0 in 0.397s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:58 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.info is being set with open permissions: ugo+rw
Feb 27 02:09:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:09:59 devstack sudo[89821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.info
Feb 27 02:09:59 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:09:59 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root
Feb 27 02:09:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.info" returned: 0 in 0.398s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:09:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:09:59 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-08a494b7-2b6d-4a15-b76e-ab01fcc2395d tempest-VolumesSnapshotTestJSON-817714047 None] Create snapshot completed successfully
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (762bf028-a9e1-4194-a765-1e64f35a90cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732248dc-02eb-42a7-9520-9626c19a3448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732248dc-02eb-42a7-9520-9626c19a3448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1582232703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86898858-4b99-437b-a36c-219431931b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12dc1e1b6a8e445c88d15a42341ee359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:00Z,use_quota=True,user_id='8c9e5196d4bb45ed8c3fe2f7879cc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7246150-feb5-4f68-9df1-e03990987a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7246150-feb5-4f68-9df1-e03990987a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0654db6f-a9f3-40e2-8442-31afc1b3d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0654db6f-a9f3-40e2-8442-31afc1b3d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86898858-4b99-437b-a36c-219431931b35', 'volume_name': 'volume-86898858-4b99-437b-a36c-219431931b35', 'volume_size': 1, 'snapshot_id': '4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41225189-687d-4a6a-958a-1007ff69932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41225189-687d-4a6a-958a-1007ff69932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6018ba1e-36d8-470c-8df8-bc94f09ca65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:00 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Volume 86898858-4b99-437b-a36c-219431931b35: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86898858-4b99-437b-a36c-219431931b35', 'volume_size': 1, 'snapshot_id': '4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c'}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c-86898858-4b99-437b-a36c-219431931b35" by "_create_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c-86898858-4b99-437b-a36c-219431931b35" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Creating volume 86898858-4b99-437b-a36c-219431931b35 from snapshot 4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c {{(pid=83140) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-86898858-4b99-437b-a36c-219431931b35" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-86898858-4b99-437b-a36c-219431931b35" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] snapshot: 4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c, volume: 86898858-4b99-437b-a36c-219431931b35,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71dbadc-f2c7-46de-b4bb-90b2e0121ec1]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:00 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c
Feb 27 02:10:00 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:00 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c" returned: 0 in 0.571s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-402550b4-0d04-40b0-8375-27c5020b9934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6d70d-587d-4988-9840-4c9532392166]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:00 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934
Feb 27 02:10:00 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:01 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934" returned: 0 in 0.574s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:01 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:10:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:01 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35
Feb 27 02:10:01 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:03 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35" returned: 0 in 2.066s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:03 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46562c3-850b-4247-b8d1-30b138d89054]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:03 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934
Feb 27 02:10:03 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:04 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934" returned: 0 in 0.601s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:10:04 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Converted 1024.00 MB image at 495.35 MB/s
Feb 27 02:10:04 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35 is being set with open permissions: ugo+rw
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:04 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35
Feb 27 02:10:04 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:04 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35" returned: 0 in 0.421s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-86898858-4b99-437b-a36c-219431931b35" released by "_copy_volume_from_snapshot" :: held 4.288s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c-86898858-4b99-437b-a36c-219431931b35" released by "_create_volume_from_snapshot" :: held 4.303s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.312s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6018ba1e-36d8-470c-8df8-bc94f09ca65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86898858-4b99-437b-a36c-219431931b35', 'volume_size': 1, 'snapshot_id': '4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d835d3f-0a57-4d0c-8d5a-dbeb9c58b98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:04 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Volume volume-86898858-4b99-437b-a36c-219431931b35 (86898858-4b99-437b-a36c-219431931b35): created successfully
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d835d3f-0a57-4d0c-8d5a-dbeb9c58b98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Flow 'volume_create_manager' (762bf028-a9e1-4194-a765-1e64f35a90cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:04 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-11daa30b-4d3c-42b6-9d45-51cfe667bc96 tempest-VolumesSnapshotTestJSON-817714047 None] Created volume successfully.
Feb 27 02:10:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-86898858-4b99-437b-a36c-219431931b35-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-86898858-4b99-437b-a36c-219431931b35-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-86898858-4b99-437b-a36c-219431931b35" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-86898858-4b99-437b-a36c-219431931b35" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:05 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[47778b62-fdd4-4ce7-8caf-b5772ead72b3]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:05 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35
Feb 27 02:10:05 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:06 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35" returned: 0 in 0.546s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:06 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35
Feb 27 02:10:06 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:06 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-86898858-4b99-437b-a36c-219431931b35" returned: 0 in 0.401s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-86898858-4b99-437b-a36c-219431931b35" released by "delete_volume" :: held 0.983s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Created reservations ['e9d99c72-7423-4e64-8049-50c3f5475657', '385c3ad5-cb8a-47dd-800c-d7a897c22dbf', 'a889d94c-ad3c-4bab-a207-f694c1fe577f', '674a35ca-0dcf-4e85-a1d4-2bbef8ca6159'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:06 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:10:06 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-402550b4-0d04-40b0-8375-27c5020b9934" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-402550b4-0d04-40b0-8375-27c5020b9934" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Deleting offline snapshot 4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c of volume 402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] snapshot_file for this snap is: volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb65ae6-80a2-40b1-8858-9dc15cc53358]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:06 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c
Feb 27 02:10:06 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:07 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.468s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:07 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:10:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Deleted volume successfully.
Feb 27 02:10:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-58671f81-6dc0-47d0-a48b-4f4cf1f4aac0 tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-86898858-4b99-437b-a36c-219431931b35-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:07 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c" returned: 0 in 0.543s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-402550b4-0d04-40b0-8375-27c5020b9934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:10:07 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f18fd7-a385-407d-96cd-6bc940a2cbb1]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:07 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934
Feb 27 02:10:07 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:07 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934" returned: 0 in 0.481s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:07 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c
Feb 27 02:10:07 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:08 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c" returned: 0 in 0.445s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:08 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c
Feb 27 02:10:08 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:08 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934.4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c" returned: 0 in 0.410s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c" released by "_delete_snapshot" :: held 1.947s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-402550b4-0d04-40b0-8375-27c5020b9934" released by "delete_snapshot" :: held 1.963s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:08 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Created reservations ['0ce2f1a3-f77a-4719-856c-465c3c9267c0', 'a8fd9673-68fd-450a-81a4-7f7817631975', '9e026321-f4da-4161-b40c-b680908f68a8', 'b4b2eba6-00c0-4d94-8d67-a2d8a2906f13'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:10:08 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Delete snapshot completed successfully.
Feb 27 02:10:08 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4da2382b-e518-461d-b314-9a80d072c1ae tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-4f9c0471-bb8a-4f47-b5bc-2a1cc05b769c-delete_snapshot" released by "delete_snapshot" :: held 2.061s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-402550b4-0d04-40b0-8375-27c5020b9934-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-402550b4-0d04-40b0-8375-27c5020b9934-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-402550b4-0d04-40b0-8375-27c5020b9934" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-402550b4-0d04-40b0-8375-27c5020b9934" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:09 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[4124d230-8de3-4d8d-8feb-f977650b05d9]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:09 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934
Feb 27 02:10:09 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:09 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934" returned: 0 in 0.459s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:09 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934
Feb 27 02:10:09 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:10 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-402550b4-0d04-40b0-8375-27c5020b9934" returned: 0 in 0.405s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-402550b4-0d04-40b0-8375-27c5020b9934" released by "delete_volume" :: held 0.898s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Created reservations ['4ffc1f56-a039-4947-ba6c-b2f1511d0f11', '0cc95309-8eea-47bc-96bb-ed1fcff2a5c3', '85c9cbf9-6ccb-4d2b-bbf1-2325dea69ab8', '65f343f3-9833-4e9d-8df9-8e3ca34fb925'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:10 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:10:10 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-5f328460-3696-4ef4-aaa8-d81ba2c33207-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-5f328460-3696-4ef4-aaa8-d81ba2c33207-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "cinder-quobyte-5f328460-3696-4ef4-aaa8-d81ba2c33207" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-5f328460-3696-4ef4-aaa8-d81ba2c33207" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa242101-db08-4be7-bcb3-fa64aaf6ec42]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:10 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207
Feb 27 02:10:10 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:10 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.459s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:10:10 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Deleted volume successfully.
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b1fb1ae-21eb-41f3-8aad-ddcf9b21bf6f tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-402550b4-0d04-40b0-8375-27c5020b9934-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:10 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207" returned: 0 in 0.490s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:10 devstack sudo[89900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207
Feb 27 02:10:10 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:11 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5f328460-3696-4ef4-aaa8-d81ba2c33207" returned: 0 in 0.408s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-quobyte-5f328460-3696-4ef4-aaa8-d81ba2c33207" released by "delete_volume" :: held 0.939s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Created reservations ['1229ba07-0552-4f2b-a4b0-138624d9baa7', '27a515c5-a2b1-4c75-968e-32b7dca46017', '59b94c08-eaa9-44c4-8daf-e29c3697bf09', 'cbf575f0-8ead-4acb-93b9-bdb9026f955b'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:11 devstack sudo[89903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:10:11 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:11 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.439s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:10:11 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Deleted volume successfully.
Feb 27 02:10:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0fcc1fe3-b923-4180-ae4d-0be4aa07c22c tempest-VolumesSnapshotTestJSON-817714047 None] Lock "cinder-5f328460-3696-4ef4-aaa8-d81ba2c33207-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Flow 'volume_create_manager' (fe68ef07-fb5b-471f-8556-756c1a7b2905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03f5f52-2156-44d5-ac53-45cab5078929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03f5f52-2156-44d5-ac53-45cab5078929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-507796552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7857243-f79b-4775-9591-e5589abedc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d33022a7c2d44d4a9bff8d56d7d9702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:16Z,use_quota=True,user_id='2cf5e04dd627478daf245cc2dbce4152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fcdfac-d270-4e34-b1b2-098e3e2b532f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fcdfac-d270-4e34-b1b2-098e3e2b532f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf03d9e-554f-4e4b-9bd2-9aa99eda6ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf03d9e-554f-4e4b-9bd2-9aa99eda6ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7857243-f79b-4775-9591-e5589abedc34', 'volume_name': 'volume-c7857243-f79b-4775-9591-e5589abedc34', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75504d5-e6d6-497a-92e4-6ed219aabe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75504d5-e6d6-497a-92e4-6ed219aabe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f0eee5-22e2-4144-a6d1-e253ca12d2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:15 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Volume c7857243-f79b-4775-9591-e5589abedc34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7857243-f79b-4775-9591-e5589abedc34', 'volume_size': 1}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-507796552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7857243-f79b-4775-9591-e5589abedc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d33022a7c2d44d4a9bff8d56d7d9702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:16Z,use_quota=True,user_id='2cf5e04dd627478daf245cc2dbce4152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Creating volume c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:10:15 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:10:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:15 devstack sudo[89909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 1073741824
Feb 27 02:10:15 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:16 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 1073741824" returned: 0 in 0.492s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:16 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34
Feb 27 02:10:16 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:16 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34" returned: 0 in 0.386s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:16 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:10:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f0eee5-22e2-4144-a6d1-e253ca12d2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7857243-f79b-4775-9591-e5589abedc34', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c667760-1db1-4137-a206-09ef8183774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:16 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Volume volume-c7857243-f79b-4775-9591-e5589abedc34 (c7857243-f79b-4775-9591-e5589abedc34): created successfully
Feb 27 02:10:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c667760-1db1-4137-a206-09ef8183774b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:16 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Flow 'volume_create_manager' (fe68ef07-fb5b-471f-8556-756c1a7b2905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:16 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e2a6be92-935c-4f7a-8362-996107511d13 tempest-VolumeDependencyTests-34005437 None] Created volume successfully.
Feb 27 02:10:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:17 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Creating offline snapshot e272a03d-183d-42bf-a692-303d2227b198 of volume c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:10:17 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac71407b-99f1-4284-acbf-0b0b07e8f507]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:18 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34
Feb 27 02:10:18 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:18 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34" returned: 0 in 0.464s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:18 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 1G
Feb 27 02:10:18 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:18 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 1G" returned: 0 in 0.476s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7857243-f79b-4775-9591-e5589abedc34 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:18 devstack sudo[89927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7857243-f79b-4775-9591-e5589abedc34 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198
Feb 27 02:10:18 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:19 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7857243-f79b-4775-9591-e5589abedc34 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198" returned: 0 in 0.438s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:19 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 is being set with open permissions: ugo+rw
Feb 27 02:10:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:19 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198
Feb 27 02:10:19 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:19 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198" returned: 0 in 0.408s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:19 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.info
Feb 27 02:10:19 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:20 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.info" returned: 0 in 0.413s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:20 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.info is being set with open permissions: ugo+rw
Feb 27 02:10:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:20 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.info
Feb 27 02:10:20 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:20 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.info" returned: 0 in 0.404s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:20 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9c5a12f5-f359-47b1-88bb-ff1055860c78 tempest-VolumeDependencyTests-34005437 None] Create snapshot completed successfully
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Flow 'volume_create_manager' (2686ca10-ed16-4a0e-bf2e-b0521b9199b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cba80e-d0da-4348-b4f8-4106611bfe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cba80e-d0da-4348-b4f8-4106611bfe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2101035020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3611be71-5357-42ff-af9e-47ed9c9fa819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d33022a7c2d44d4a9bff8d56d7d9702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e272a03d-183d-42bf-a692-303d2227b198,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:21Z,use_quota=True,user_id='2cf5e04dd627478daf245cc2dbce4152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1f2072-72e9-4372-abfe-9c01d7691d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1f2072-72e9-4372-abfe-9c01d7691d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f8538-8b1c-4da8-8c4c-5ea918693918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f8538-8b1c-4da8-8c4c-5ea918693918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3611be71-5357-42ff-af9e-47ed9c9fa819', 'volume_name': 'volume-3611be71-5357-42ff-af9e-47ed9c9fa819', 'volume_size': 1, 'snapshot_id': 'e272a03d-183d-42bf-a692-303d2227b198'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53959daf-fa6c-42ab-91a0-4a2a48bc8aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53959daf-fa6c-42ab-91a0-4a2a48bc8aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2390890-c5b6-465a-9ca4-aa17f4b522a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:21 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Volume 3611be71-5357-42ff-af9e-47ed9c9fa819: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3611be71-5357-42ff-af9e-47ed9c9fa819', 'volume_size': 1, 'snapshot_id': 'e272a03d-183d-42bf-a692-303d2227b198'}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-e272a03d-183d-42bf-a692-303d2227b198-3611be71-5357-42ff-af9e-47ed9c9fa819" by "_create_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-e272a03d-183d-42bf-a692-303d2227b198-3611be71-5357-42ff-af9e-47ed9c9fa819" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Creating volume 3611be71-5357-42ff-af9e-47ed9c9fa819 from snapshot e272a03d-183d-42bf-a692-303d2227b198 {{(pid=83140) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-3611be71-5357-42ff-af9e-47ed9c9fa819" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-3611be71-5357-42ff-af9e-47ed9c9fa819" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] snapshot: e272a03d-183d-42bf-a692-303d2227b198, volume: 3611be71-5357-42ff-af9e-47ed9c9fa819,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[956fcb83-1de6-49a5-a2c3-5d03cbebdb94]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:21 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198
Feb 27 02:10:21 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:21 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198" returned: 0 in 0.480s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7857243-f79b-4775-9591-e5589abedc34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c20c50-5c7d-4f12-958e-c298987a0321]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:22 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34
Feb 27 02:10:22 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:22 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34" returned: 0 in 0.512s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:22 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:10:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:22 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819
Feb 27 02:10:22 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:24 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819" returned: 0 in 1.949s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:24 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9367c9e-da53-4462-8407-3fa289a05d1f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:24 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34
Feb 27 02:10:24 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:25 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34" returned: 0 in 0.711s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:10:25 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Converted 1024.00 MB image at 525.10 MB/s
Feb 27 02:10:25 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819 is being set with open permissions: ugo+rw
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:25 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819
Feb 27 02:10:25 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:25 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819" returned: 0 in 0.477s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-3611be71-5357-42ff-af9e-47ed9c9fa819" released by "_copy_volume_from_snapshot" :: held 4.185s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-e272a03d-183d-42bf-a692-303d2227b198-3611be71-5357-42ff-af9e-47ed9c9fa819" released by "_create_volume_from_snapshot" :: held 4.202s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.210s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=127,cinder:UPDATE=148,cinder:INSERT=36,cinder:DELETE=11 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2390890-c5b6-465a-9ca4-aa17f4b522a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3611be71-5357-42ff-af9e-47ed9c9fa819', 'volume_size': 1, 'snapshot_id': 'e272a03d-183d-42bf-a692-303d2227b198'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357cf7f2-87fd-49a6-b0cf-ab9a51c32625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:25 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Volume volume-3611be71-5357-42ff-af9e-47ed9c9fa819 (3611be71-5357-42ff-af9e-47ed9c9fa819): created successfully
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357cf7f2-87fd-49a6-b0cf-ab9a51c32625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Flow 'volume_create_manager' (2686ca10-ed16-4a0e-bf2e-b0521b9199b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:25 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-265ecf75-f089-44ad-957c-6b69bc048b04 tempest-VolumeDependencyTests-34005437 None] Created volume successfully.
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-e272a03d-183d-42bf-a692-303d2227b198-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Lock "cinder-e272a03d-183d-42bf-a692-303d2227b198-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-c7857243-f79b-4775-9591-e5589abedc34" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-c7857243-f79b-4775-9591-e5589abedc34" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-e272a03d-183d-42bf-a692-303d2227b198" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-e272a03d-183d-42bf-a692-303d2227b198" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Deleting offline snapshot e272a03d-183d-42bf-a692-303d2227b198 of volume c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] snapshot_file for this snap is: volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcb6533-d21f-4f63-b712-3972260935d6]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:26 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198
Feb 27 02:10:26 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:27 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198" returned: 0 in 0.497s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7857243-f79b-4775-9591-e5589abedc34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:10:27 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4a7b04-1dcd-4a10-92af-53d35583e320]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:27 devstack sudo[89977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34
Feb 27 02:10:27 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:27 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34" returned: 0 in 0.496s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:27 devstack sudo[89982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198
Feb 27 02:10:27 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:28 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198" returned: 0 in 0.486s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:28 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198
Feb 27 02:10:28 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:28 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34.e272a03d-183d-42bf-a692-303d2227b198" returned: 0 in 0.490s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-e272a03d-183d-42bf-a692-303d2227b198" released by "_delete_snapshot" :: held 2.025s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-c7857243-f79b-4775-9591-e5589abedc34" released by "delete_snapshot" :: held 2.036s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:28 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Created reservations ['b97ab9db-5a52-46f4-9f30-c103c3b0c43d', '2fef179e-e4f8-4511-9ef5-397219b9374a', 'd20cc01a-51b2-4eb5-84f8-1405fe9aa252', '61c50d69-6229-4c98-b488-bd5d34793d1f'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:10:28 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Delete snapshot completed successfully.
Feb 27 02:10:28 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9fcbcf62-10ae-4b1a-a9e6-628b93eb085a tempest-VolumeDependencyTests-34005437 None] Lock "cinder-e272a03d-183d-42bf-a692-303d2227b198-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-c7857243-f79b-4775-9591-e5589abedc34-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-c7857243-f79b-4775-9591-e5589abedc34-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-c7857243-f79b-4775-9591-e5589abedc34" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:29 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-c7857243-f79b-4775-9591-e5589abedc34" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:29 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0b33c8-172c-416c-94ba-d832b8687ba8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:30 devstack sudo[89990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34
Feb 27 02:10:30 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:30 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34" returned: 0 in 0.518s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:30 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34
Feb 27 02:10:30 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:30 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-c7857243-f79b-4775-9591-e5589abedc34" returned: 0 in 0.468s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:30 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-c7857243-f79b-4775-9591-e5589abedc34" released by "delete_volume" :: held 1.037s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:30 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=113,cinder:UPDATE=147,cinder:INSERT=36,cinder:DELETE=12 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Created reservations ['7070e365-7396-4261-bcd1-e3efaead2f6a', '63af6e5b-1f76-4a48-af41-da0551016a7d', '1062053f-6f31-4f29-93dd-917cf6b38093', 'b9a9ac96-b092-4e29-b2ee-d5e8e4e8c1e3'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:31 devstack sudo[89998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:10:31 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:31 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.437s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:10:31 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Deleted volume successfully.
Feb 27 02:10:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6f424e52-f292-448e-aec5-e5c6b5bab1f4 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-c7857243-f79b-4775-9591-e5589abedc34-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Flow 'volume_create_manager' (e274f18d-96fb-4f95-a22e-df6ab171d70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16dda40-59ca-44c7-ab21-20971a122008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16dda40-59ca-44c7-ab21-20971a122008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-6049868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7e1de8-2233-43ff-b0ef-73e583709d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d33022a7c2d44d4a9bff8d56d7d9702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:32Z,use_quota=True,user_id='2cf5e04dd627478daf245cc2dbce4152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65efced-0307-4a5b-890a-dd73ea420831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65efced-0307-4a5b-890a-dd73ea420831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e2f8ee-dc90-46de-9126-b4ba5e11b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e2f8ee-dc90-46de-9126-b4ba5e11b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7e1de8-2233-43ff-b0ef-73e583709d12', 'volume_name': 'volume-7f7e1de8-2233-43ff-b0ef-73e583709d12', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c6a7f7-6e80-44cf-ad5c-5dc9067d210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c6a7f7-6e80-44cf-ad5c-5dc9067d210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df61058b-64d4-4f54-9beb-4cea5c1eb385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:32 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Volume 7f7e1de8-2233-43ff-b0ef-73e583709d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7e1de8-2233-43ff-b0ef-73e583709d12', 'volume_size': 1}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-6049868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7e1de8-2233-43ff-b0ef-73e583709d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d33022a7c2d44d4a9bff8d56d7d9702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:32Z,use_quota=True,user_id='2cf5e04dd627478daf245cc2dbce4152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Creating volume 7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:10:32 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:32 devstack sudo[90001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 1073741824
Feb 27 02:10:32 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:32 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:10:32 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:33 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 1073741824" returned: 0 in 0.528s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:33 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.464s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:10:33 devstack sudo[90010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12
Feb 27 02:10:33 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:33 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12" returned: 0 in 0.445s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df61058b-64d4-4f54-9beb-4cea5c1eb385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7e1de8-2233-43ff-b0ef-73e583709d12', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f678d4-c0fc-4c6f-bc85-1fed5b17175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:33 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Volume volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 (7f7e1de8-2233-43ff-b0ef-73e583709d12): created successfully
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f678d4-c0fc-4c6f-bc85-1fed5b17175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Flow 'volume_create_manager' (e274f18d-96fb-4f95-a22e-df6ab171d70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:33 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-53cd3798-57f1-4abd-abbd-2f8f37f9f0ac tempest-VolumeDependencyTests-34005437 None] Created volume successfully.
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Flow 'volume_create_manager' (d1747702-0b3d-4ec4-bae6-8c985cd95d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257679df-da8f-4801-8e2d-862c3a1beae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257679df-da8f-4801-8e2d-862c3a1beae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-691523358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14670b1f-e19c-4d1b-bba4-d71d0da3e4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d33022a7c2d44d4a9bff8d56d7d9702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=7f7e1de8-2233-43ff-b0ef-73e583709d12,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:35Z,use_quota=True,user_id='2cf5e04dd627478daf245cc2dbce4152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f88f813-c084-42cc-8306-6ff6e1eec697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f88f813-c084-42cc-8306-6ff6e1eec697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76558f30-4ba7-4aa2-bbd1-4e58388e1912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76558f30-4ba7-4aa2-bbd1-4e58388e1912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '14670b1f-e19c-4d1b-bba4-d71d0da3e4b2', 'volume_name': 'volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2', 'volume_size': 1, 'source_volid': '7f7e1de8-2233-43ff-b0ef-73e583709d12', 'source_volstatus': 'available'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae59435-7965-449c-8c95-c0dfecea84d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae59435-7965-449c-8c95-c0dfecea84d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9f5189-fd97-41ea-a59c-b66c0f421c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:35 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Volume 14670b1f-e19c-4d1b-bba4-d71d0da3e4b2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2', 'volume_size': 1, 'source_volid': '7f7e1de8-2233-43ff-b0ef-73e583709d12', 'source_volstatus': 'available'}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:35 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Cloning volume 7f7e1de8-2233-43ff-b0ef-73e583709d12 to volume 14670b1f-e19c-4d1b-bba4-d71d0da3e4b2
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Creating offline snapshot 4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 of volume 7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b68a297-101b-4190-8303-4abfe3c6ff00]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:36 devstack sudo[90013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12
Feb 27 02:10:36 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:36 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12" returned: 0 in 0.558s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:36 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 1G
Feb 27 02:10:36 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:36 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 1G" returned: 0 in 0.439s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:36 devstack sudo[90024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980
Feb 27 02:10:36 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:37 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980" returned: 0 in 0.415s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:37 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 is being set with open permissions: ugo+rw
Feb 27 02:10:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:37 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980
Feb 27 02:10:37 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:37 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980" returned: 0 in 0.412s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:39 devstack sudo[90032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.info
Feb 27 02:10:39 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:39 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.info" returned: 0 in 0.404s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:39 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.info is being set with open permissions: ugo+rw
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:39 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.info
Feb 27 02:10:39 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:39 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.info" returned: 0 in 0.401s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] snapshot: 4d1e4a61-87b3-4f8b-aebc-3e3b223a8980, volume: 14670b1f-e19c-4d1b-bba4-d71d0da3e4b2,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d37e79-7835-4efd-a21d-989470d3964a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:39 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980
Feb 27 02:10:39 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:40 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980" returned: 0 in 0.471s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7e1de8-2233-43ff-b0ef-73e583709d12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:10:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:10:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:10:40 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b27231-caa2-46a9-9e85-245755482b6d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:40 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12
Feb 27 02:10:40 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:40 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12" returned: 0 in 0.491s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:40 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:10:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:40 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2
Feb 27 02:10:40 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:42 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" returned: 0 in 1.988s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:42 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ded2d-835b-4404-b100-88d387f808de]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:42 devstack sudo[90100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12
Feb 27 02:10:42 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:43 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12" returned: 0 in 0.590s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:10:43 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Converted 1024.00 MB image at 514.66 MB/s
Feb 27 02:10:43 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2 is being set with open permissions: ugo+rw
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:43 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2
Feb 27 02:10:43 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:43 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" returned: 0 in 0.415s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" released by "_copy_volume_from_snapshot" :: held 3.997s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-4d1e4a61-87b3-4f8b-aebc-3e3b223a8980" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-4d1e4a61-87b3-4f8b-aebc-3e3b223a8980" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Deleting offline snapshot 4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 of volume 7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] snapshot_file for this snap is: volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[593a7369-0276-48db-874d-5a0ba57f3d87]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:43 devstack sudo[90109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980
Feb 27 02:10:43 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:44 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980" returned: 0 in 0.472s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:44 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7e1de8-2233-43ff-b0ef-73e583709d12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:10:44 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1982b0-7b49-4c7f-ad46-665f48dc836a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:44 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12
Feb 27 02:10:44 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:44 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12" returned: 0 in 0.451s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:44 devstack sudo[90119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980
Feb 27 02:10:44 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:45 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980" returned: 0 in 0.491s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:45 devstack sudo[90124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980
Feb 27 02:10:45 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:45 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12.4d1e4a61-87b3-4f8b-aebc-3e3b223a8980" returned: 0 in 0.407s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-4d1e4a61-87b3-4f8b-aebc-3e3b223a8980" released by "_delete_snapshot" :: held 1.869s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.029s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9f5189-fd97-41ea-a59c-b66c0f421c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2', 'volume_size': 1, 'source_volid': '7f7e1de8-2233-43ff-b0ef-73e583709d12', 'source_volstatus': 'available'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1a2ebc-f3d4-4303-af35-558801550dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:45 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Volume volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2 (14670b1f-e19c-4d1b-bba4-d71d0da3e4b2): created successfully
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1a2ebc-f3d4-4303-af35-558801550dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Flow 'volume_create_manager' (d1747702-0b3d-4ec4-bae6-8c985cd95d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:45 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7984419d-f526-48e0-80d9-757b0133cfd2 tempest-VolumeDependencyTests-34005437 None] Created volume successfully.
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-7f7e1de8-2233-43ff-b0ef-73e583709d12-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-7f7e1de8-2233-43ff-b0ef-73e583709d12-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-7f7e1de8-2233-43ff-b0ef-73e583709d12" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-7f7e1de8-2233-43ff-b0ef-73e583709d12" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f2ea6d-ab95-45fd-b2c2-65d7338eb88f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:46 devstack sudo[90127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12
Feb 27 02:10:46 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:46 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12" returned: 0 in 0.466s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:46 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12
Feb 27 02:10:46 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:46 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-7f7e1de8-2233-43ff-b0ef-73e583709d12" returned: 0 in 0.403s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-7f7e1de8-2233-43ff-b0ef-73e583709d12" released by "delete_volume" :: held 0.910s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:46 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Created reservations ['1c41c9c3-408e-409b-b00c-c46105ed2af8', '328ec53f-b736-48c4-b649-f2959dfe60a1', '29076c89-b123-4984-b53b-25de8e8e79be', 'ec2b4171-efbb-406a-bda1-08acb7433371'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:47 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:10:47 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Lock "cinder-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8770212-aceb-49c2-b01a-870ce6717c78]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:47 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2
Feb 27 02:10:47 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:47 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.456s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:10:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Deleted volume successfully.
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-53d4758c-b47b-4cbf-a289-4260b52940c4 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-7f7e1de8-2233-43ff-b0ef-73e583709d12-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:47 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" returned: 0 in 0.462s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:47 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2
Feb 27 02:10:47 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:48 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" returned: 0 in 0.400s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2" released by "delete_volume" :: held 0.882s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Created reservations ['c90a05fc-ce16-45f6-ab70-dea3ba58fb1c', '9713d2ca-b586-47b1-bdfa-d4b051ac89dc', '3c6e40b8-2a5a-4138-bef4-0b8f5fcfb040', '48a791d7-6140-4125-98f3-34ca73c24b7a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:48 devstack sudo[90147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:10:48 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-3611be71-5357-42ff-af9e-47ed9c9fa819-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-3611be71-5357-42ff-af9e-47ed9c9fa819-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "cinder-quobyte-3611be71-5357-42ff-af9e-47ed9c9fa819" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-3611be71-5357-42ff-af9e-47ed9c9fa819" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9597128-8cac-4cc1-9373-c6a04f486c20]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:48 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819
Feb 27 02:10:48 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:48 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.445s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:10:48 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Deleted volume successfully.
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b534cbce-380d-4cc6-9ade-30558068cfae tempest-VolumeDependencyTests-34005437 None] Lock "cinder-14670b1f-e19c-4d1b-bba4-d71d0da3e4b2-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:48 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819" returned: 0 in 0.472s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:48 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819
Feb 27 02:10:48 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:49 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3611be71-5357-42ff-af9e-47ed9c9fa819" returned: 0 in 0.411s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-quobyte-3611be71-5357-42ff-af9e-47ed9c9fa819" released by "delete_volume" :: held 0.907s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Created reservations ['0c7ffe5c-4f84-4599-8cb4-9ec51f76ba92', '1a951b78-13c5-4db9-8752-bdab08d14399', '60c3a1dc-a9b7-48ae-ab71-69072c16d16d', '479f25c2-a296-4dec-bd32-22487a417c3c'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:49 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:10:49 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:49 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.491s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:10:49 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Deleted volume successfully.
Feb 27 02:10:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6d2a988c-124e-4d44-9b73-3163eb69f917 tempest-VolumeDependencyTests-34005437 None] Lock "cinder-3611be71-5357-42ff-af9e-47ed9c9fa819-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Flow 'volume_create_manager' (9f2fa318-058a-43df-afea-3ef283cd6615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b762f527-5033-413f-a6bc-af82e664ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b762f527-5033-413f-a6bc-af82e664ced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-703608044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21fe079-9557-4e4f-a302-f42aaca4f1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b32d8e337242deafc1ea25fb129fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='98920bf1831346a28e1a66d5cf154482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c49e240-b33a-45c2-9685-146651408988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c49e240-b33a-45c2-9685-146651408988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480e6452-20bf-4fac-8866-0530edd5a6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480e6452-20bf-4fac-8866-0530edd5a6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e21fe079-9557-4e4f-a302-f42aaca4f1f8', 'volume_name': 'volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c424105-beff-4365-a52e-dfb98246961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c424105-beff-4365-a52e-dfb98246961d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a8192e-e9ea-4abf-8687-e053e36c1347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:56 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Volume e21fe079-9557-4e4f-a302-f42aaca4f1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8', 'volume_size': 1}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-703608044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21fe079-9557-4e4f-a302-f42aaca4f1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b32d8e337242deafc1ea25fb129fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='98920bf1831346a28e1a66d5cf154482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Creating volume e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:10:56 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:56 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 1073741824
Feb 27 02:10:56 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (60aaacea-f476-461c-a1ed-13fe744c381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e14787-dd24-49b5-9b25-734a33af6264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e14787-dd24-49b5-9b25-734a33af6264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891471075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22738b4c-2b0f-48a5-beb0-4cb70d947bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:56 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be31b7a-1f49-4e9b-b947-87f21a9eba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be31b7a-1f49-4e9b-b947-87f21a9eba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ae30fb-a79b-4786-9ec5-7fd72731a4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ae30fb-a79b-4786-9ec5-7fd72731a4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22738b4c-2b0f-48a5-beb0-4cb70d947bd0', 'volume_name': 'volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4448711-6939-4f24-a43f-a5e3bc0312a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4448711-6939-4f24-a43f-a5e3bc0312a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4df606d-598e-4deb-b8b7-34e6eda3c730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Volume 22738b4c-2b0f-48a5-beb0-4cb70d947bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0', 'volume_size': 1}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (d3a084b6-24c3-45d3-8537-964e3e45f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbcfe09-5dc4-42d4-a4b7-2a59810f954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbcfe09-5dc4-42d4-a4b7-2a59810f954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497706560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f3027f-a5b4-480a-90ff-4cdff561a623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5482eb00-14b1-4401-a6db-32ced53d3189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5482eb00-14b1-4401-a6db-32ced53d3189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb266e6-40a1-4d9b-b906-8af240762059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb266e6-40a1-4d9b-b906-8af240762059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f3027f-a5b4-480a-90ff-4cdff561a623', 'volume_name': 'volume-99f3027f-a5b4-480a-90ff-4cdff561a623', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242fbc69-fcc8-4bf6-94d0-c91abcc1ba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242fbc69-fcc8-4bf6-94d0-c91abcc1ba3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2b1ebc-7aac-4b91-b2d1-215bb1ff1db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume 99f3027f-a5b4-480a-90ff-4cdff561a623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f3027f-a5b4-480a-90ff-4cdff561a623', 'volume_size': 1}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (fc063e15-fbde-4fab-b40d-213d8eae3c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51d17fd-9182-430e-b7c6-f41f5338d244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51d17fd-9182-430e-b7c6-f41f5338d244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-12316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa92eed-9cb5-4d12-9e5a-0cc09d72acb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa92eed-9cb5-4d12-9e5a-0cc09d72acb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54966179-dd2c-4da4-9945-4358e46d0e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54966179-dd2c-4da4-9945-4358e46d0e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9', 'volume_name': 'volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3696a475-f58a-40f4-b60a-80628a355008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3696a475-f58a-40f4-b60a-80628a355008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc5850e-f147-4e3f-9bba-799a9f712481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Volume 28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9', 'volume_size': 1}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (822ff2cc-e857-4c5d-9c18-4e0ea0560a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fe35b6-30d9-4788-a0ae-a1c677ee9112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fe35b6-30d9-4788-a0ae-a1c677ee9112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1033871943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9f1a6e-0d50-45ac-8e30-49e71e457e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2f154c-0ab5-4ffa-999f-6f5d6b171d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2f154c-0ab5-4ffa-999f-6f5d6b171d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a65200-da9a-4480-ab84-4a905d194c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a65200-da9a-4480-ab84-4a905d194c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9f1a6e-0d50-45ac-8e30-49e71e457e26', 'volume_name': 'volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095637be-b3d2-4376-87a9-9046859d80dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095637be-b3d2-4376-87a9-9046859d80dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3eb0ae-0589-49da-ba5e-a85b469dc2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Volume 4e9f1a6e-0d50-45ac-8e30-49e71e457e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26', 'volume_size': 1}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:57 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 1073741824" returned: 0 in 0.732s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:57 devstack sudo[90209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8
Feb 27 02:10:57 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (d25bf02b-8ad4-4c36-b564-f3dbc0d2650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dc2e32-924b-4902-85f0-b4dcc70b4199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dc2e32-924b-4902-85f0-b4dcc70b4199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708690497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97d19f1-b73e-4735-8465-25717a78dcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1b5ddd-85e0-4fbf-9419-c7d74f77a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1b5ddd-85e0-4fbf-9419-c7d74f77a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdda5b9-1287-4439-a6f4-aa2febbed384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdda5b9-1287-4439-a6f4-aa2febbed384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97d19f1-b73e-4735-8465-25717a78dcb2', 'volume_name': 'volume-b97d19f1-b73e-4735-8465-25717a78dcb2', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a4173f-ccce-407a-bf94-1ae87ee9e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a4173f-ccce-407a-bf94-1ae87ee9e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f4fab1-ac5a-4500-b139-4e0ec756b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Volume b97d19f1-b73e-4735-8465-25717a78dcb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97d19f1-b73e-4735-8465-25717a78dcb2', 'volume_size': 1}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (32ed8f1a-d94b-47c3-bfd3-156720610a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f156f6-0aae-4f08-8fd7-2844122dfd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f156f6-0aae-4f08-8fd7-2844122dfd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-543400062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5475c136-ac6b-46d2-a2d7-1cb38bc52909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5475c136-ac6b-46d2-a2d7-1cb38bc52909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39b6d2f-4b90-4b4a-b305-638ea33f224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39b6d2f-4b90-4b4a-b305-638ea33f224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f', 'volume_name': 'volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86785eef-4c18-437c-874b-959ef2fc266a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:57 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86785eef-4c18-437c-874b-959ef2fc266a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0abdb2-2f14-4739-a6c9-293f4d423107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:58 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Volume 138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f', 'volume_size': 1}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:58 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8" returned: 0 in 0.481s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.978s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891471075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22738b4c-2b0f-48a5-beb0-4cb70d947bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Creating volume 22738b4c-2b0f-48a5-beb0-4cb70d947bd0 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:10:58 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a8192e-e9ea-4abf-8687-e053e36c1347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:58 devstack sudo[90212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0 1073741824
Feb 27 02:10:58 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63838edb-8ed1-4005-80b8-1baa7e772922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:58 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Volume volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 (e21fe079-9557-4e4f-a302-f42aaca4f1f8): created successfully
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63838edb-8ed1-4005-80b8-1baa7e772922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Flow 'volume_create_manager' (9f2fa318-058a-43df-afea-3ef283cd6615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:58 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-97b18493-1b50-4ff8-aa44-0c661e9a8631 tempest-VolumeDependencyTests-361767958 None] Created volume successfully.
Feb 27 02:10:58 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0 1073741824" returned: 0 in 0.558s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:58 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0
Feb 27 02:10:58 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:59 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0" returned: 0 in 0.536s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.988s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497706560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f3027f-a5b4-480a-90ff-4cdff561a623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Creating volume 99f3027f-a5b4-480a-90ff-4cdff561a623 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:10:59 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4df606d-598e-4deb-b8b7-34e6eda3c730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ac88da-d3b3-446c-81f3-c1106441fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:10:59 devstack sudo[90220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623 1073741824
Feb 27 02:10:59 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:10:59 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Volume volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0 (22738b4c-2b0f-48a5-beb0-4cb70d947bd0): created successfully
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ac88da-d3b3-446c-81f3-c1106441fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (60aaacea-f476-461c-a1ed-13fe744c381e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:10:59 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-f49cb457-87d6-40ea-9ac3-d7fa41f0d302 tempest-CreateVolumesFromImageTest-1172888740 None] Created volume successfully.
Feb 27 02:10:59 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623 1073741824" returned: 0 in 0.500s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:10:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:10:59 devstack sudo[90225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623
Feb 27 02:10:59 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:00 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623" returned: 0 in 0.582s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.018s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-12316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Creating volume 28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:00 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2b1ebc-7aac-4b91-b2d1-215bb1ff1db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f3027f-a5b4-480a-90ff-4cdff561a623', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:00 devstack sudo[90228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9 1073741824
Feb 27 02:11:00 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c5788c-0930-4459-b4b5-6a8bb3d47f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:00 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume volume-99f3027f-a5b4-480a-90ff-4cdff561a623 (99f3027f-a5b4-480a-90ff-4cdff561a623): created successfully
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c5788c-0930-4459-b4b5-6a8bb3d47f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (d3a084b6-24c3-45d3-8537-964e3e45f868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:00 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-c5db2d75-7619-4471-b73c-ddbc26bd6817 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created volume successfully.
Feb 27 02:11:00 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9 1073741824" returned: 0 in 0.542s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:00 devstack sudo[90233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9
Feb 27 02:11:00 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:01 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9" returned: 0 in 0.474s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.830s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1033871943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9f1a6e-0d50-45ac-8e30-49e71e457e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:57Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Creating volume 4e9f1a6e-0d50-45ac-8e30-49e71e457e26 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:01 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc5850e-f147-4e3f-9bba-799a9f712481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a55740d-b5e3-4fd1-83c8-40ccce446294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Volume volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9 (28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9): created successfully
Feb 27 02:11:01 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26 1073741824
Feb 27 02:11:01 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a55740d-b5e3-4fd1-83c8-40ccce446294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (fc063e15-fbde-4fab-b40d-213d8eae3c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:01 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-a53145bd-86a9-493f-9123-838e72810a1c tempest-CreateVolumesFromImageTest-1172888740 None] Created volume successfully.
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (acdbcc52-44a8-45e2-93b6-3d00b87eb969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3496acdc-64f6-4472-b83c-5ed79cca5be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3496acdc-64f6-4472-b83c-5ed79cca5be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522079548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63f96a2-8989-4a4f-bf7d-20eb218e350d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:01Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4210ae5-0529-480d-9276-102a7f413387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4210ae5-0529-480d-9276-102a7f413387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47a1a7f-5078-46b4-a5da-03ecc74600c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47a1a7f-5078-46b4-a5da-03ecc74600c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63f96a2-8989-4a4f-bf7d-20eb218e350d', 'volume_name': 'volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67496a7a-fc0d-4d47-86d1-c73646f14dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67496a7a-fc0d-4d47-86d1-c73646f14dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48ee88a-7307-476e-ad38-b75dfd469a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume b63f96a2-8989-4a4f-bf7d-20eb218e350d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d', 'volume_size': 1}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (f43669af-809c-4446-a5e2-58729000d514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc96345f-b557-4413-b4a7-9fb668d0ecb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc96345f-b557-4413-b4a7-9fb668d0ecb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-563803680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64723972-1cc9-46f8-8e6c-3a73f3259c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:02Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2cac13-4be5-40d9-9b20-e8411a139e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2cac13-4be5-40d9-9b20-e8411a139e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d61f9bf-f59b-4c85-9935-4d89920918a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d61f9bf-f59b-4c85-9935-4d89920918a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64723972-1cc9-46f8-8e6c-3a73f3259c8a', 'volume_name': 'volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb685da-4892-44b2-9567-1e3576eb3822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb685da-4892-44b2-9567-1e3576eb3822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6a49b8-d095-4f69-b792-c4e16d479ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:01 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume 64723972-1cc9-46f8-8e6c-3a73f3259c8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a', 'volume_size': 1}
Feb 27 02:11:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (50d6ab43-8ebe-4d6c-8055-887a2251780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f749111-00fd-47af-94df-91d5f221061f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f749111-00fd-47af-94df-91d5f221061f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-145104940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3477cd74-91d1-4a91-8bec-77f3ac79cc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:02Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6df4ad-c1f5-4440-8628-416286f5129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6df4ad-c1f5-4440-8628-416286f5129d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605971a3-8b24-4e32-b067-dfebda23d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605971a3-8b24-4e32-b067-dfebda23d598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3477cd74-91d1-4a91-8bec-77f3ac79cc3b', 'volume_name': 'volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268b34b2-ac42-4465-a548-aa785a9e0dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268b34b2-ac42-4465-a548-aa785a9e0dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd003bf9-8b1b-4d26-a4aa-39df7194a708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume 3477cd74-91d1-4a91-8bec-77f3ac79cc3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b', 'volume_size': 1}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26 1073741824" returned: 0 in 0.797s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:02 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26
Feb 27 02:11:02 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (effffe3f-3945-4544-b5fc-7edffaaadc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6ec41a-19b7-4b1b-ac42-3267fec98f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6ec41a-19b7-4b1b-ac42-3267fec98f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-655356599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976366c5-d836-4ca4-a328-84afe4b22224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:02Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c095027d-1f40-4361-8f03-e88ac82577a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c095027d-1f40-4361-8f03-e88ac82577a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ef4efd-e6c7-470b-95ef-f38a0cddd884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ef4efd-e6c7-470b-95ef-f38a0cddd884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976366c5-d836-4ca4-a328-84afe4b22224', 'volume_name': 'volume-976366c5-d836-4ca4-a328-84afe4b22224', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0afd72-c6bc-4aac-963b-26f459dd7531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0afd72-c6bc-4aac-963b-26f459dd7531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c2b9f7-5c18-496f-af05-88894ae740fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume 976366c5-d836-4ca4-a328-84afe4b22224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976366c5-d836-4ca4-a328-84afe4b22224', 'volume_size': 1}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (dd3f94ce-47af-4868-b4a8-3c7abada707c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66e33d1-4aab-4d54-8878-cf18c8caeb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66e33d1-4aab-4d54-8878-cf18c8caeb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346240898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dc1d17-3f8d-4171-817f-6facd9422f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:03Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1351988c-f24a-4327-9a51-8e45d6bc0972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1351988c-f24a-4327-9a51-8e45d6bc0972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a0508-2813-4da4-826c-bc1c59126842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a0508-2813-4da4-826c-bc1c59126842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75dc1d17-3f8d-4171-817f-6facd9422f0a', 'volume_name': 'volume-75dc1d17-3f8d-4171-817f-6facd9422f0a', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640c7afe-6711-4af6-a5a1-6f78ab9ff5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640c7afe-6711-4af6-a5a1-6f78ab9ff5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe1d92e-4fe5-45b8-be25-674715150ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume 75dc1d17-3f8d-4171-817f-6facd9422f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75dc1d17-3f8d-4171-817f-6facd9422f0a', 'volume_size': 1}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:02 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26" returned: 0 in 0.762s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.166s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708690497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97d19f1-b73e-4735-8465-25717a78dcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Creating volume b97d19f1-b73e-4735-8465-25717a78dcb2 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:02 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3eb0ae-0589-49da-ba5e-a85b469dc2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91905af-573d-4b1e-9285-bb9e2166d9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:02 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2 1073741824
Feb 27 02:11:02 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:02 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Volume volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26 (4e9f1a6e-0d50-45ac-8e30-49e71e457e26): created successfully
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91905af-573d-4b1e-9285-bb9e2166d9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:02 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (822ff2cc-e857-4c5d-9c18-4e0ea0560a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:02 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9cd8545a-4745-4ba5-afc8-754098fbbb04 tempest-CreateVolumesFromImageTest-1172888740 None] Created volume successfully.
Feb 27 02:11:03 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2 1073741824" returned: 0 in 0.617s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:03 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:03 devstack sudo[90250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2
Feb 27 02:11:03 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:04 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2" returned: 0 in 0.450s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.032s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-543400062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a2847de0754095b92bba8eb1ec32bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='3a4c9387ddb84a4fb70f50bb12e1b543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Creating volume 138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:04 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f4fab1-ac5a-4500-b139-4e0ec756b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97d19f1-b73e-4735-8465-25717a78dcb2', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54ad4e9-4f19-4d6d-8ee4-e94ca44967ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:04 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f 1073741824
Feb 27 02:11:04 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:04 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Volume volume-b97d19f1-b73e-4735-8465-25717a78dcb2 (b97d19f1-b73e-4735-8465-25717a78dcb2): created successfully
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54ad4e9-4f19-4d6d-8ee4-e94ca44967ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (d25bf02b-8ad4-4c36-b564-f3dbc0d2650d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:04 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-754f015d-79be-44ab-83ce-347ca3425ac1 tempest-CreateVolumesFromImageTest-1172888740 None] Created volume successfully.
Feb 27 02:11:04 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f 1073741824" returned: 0 in 0.567s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:04 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:04 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f
Feb 27 02:11:04 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:05 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f" returned: 0 in 0.422s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.953s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Creating offline snapshot f6fb24a5-b5ec-4dbe-868a-a9c153eca282 of volume e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0abdb2-2f14-4739-a6c9-293f4d423107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4131fa-f047-4949-9b3e-479e36b29de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b729cd-5b74-4815-b563-00e21577748a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:05 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Volume volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f (138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f): created successfully
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4131fa-f047-4949-9b3e-479e36b29de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Flow 'volume_create_manager' (32ed8f1a-d94b-47c3-bfd3-156720610a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:05 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e2f1e38a-a5c5-4400-b03b-be55311eca34 tempest-CreateVolumesFromImageTest-1172888740 None] Created volume successfully.
Feb 27 02:11:05 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8
Feb 27 02:11:05 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:05 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8" returned: 0 in 0.569s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:05 devstack sudo[90266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 1G
Feb 27 02:11:05 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-quobyte-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55abaeb-5fd9-4a55-aac3-ddfeaba06dd3]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:05 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:05 devstack sudo[90268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f
Feb 27 02:11:05 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:06 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 1G" returned: 0 in 0.559s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:06 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282
Feb 27 02:11:06 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:06 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f" returned: 0 in 0.662s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:06 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f
Feb 27 02:11:06 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:06 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282" returned: 0 in 0.542s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:06 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 is being set with open permissions: ugo+rw
Feb 27 02:11:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:06 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282
Feb 27 02:11:06 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:06 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:06 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f" returned: 0 in 0.478s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:06 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f" released by "delete_volume" :: held 1.163s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:06 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Created reservations ['0ff4d041-d3b0-441f-9ae1-9be77ce81f93', '97609f4b-5f47-4564-b633-eddc07c8af3f', '06c02bff-9f9d-4e0c-adeb-2f0843f7b072', '23cdf9b8-a704-443c-8936-2f82e28cd3e0'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:07 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:07 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:07 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282" returned: 0 in 0.525s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:07 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.info
Feb 27 02:11:07 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:07 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.469s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:07 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Deleted volume successfully.
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-befa09bd-0ec5-4166-96b1-228102ee545e tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-138c7ae8-1a92-4fe3-9dc3-47ee406a8b0f-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:07 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.info" returned: 0 in 0.501s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:07 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.info is being set with open permissions: ugo+rw
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:07 devstack sudo[90293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.info
Feb 27 02:11:07 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-b97d19f1-b73e-4735-8465-25717a78dcb2-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-b97d19f1-b73e-4735-8465-25717a78dcb2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-quobyte-b97d19f1-b73e-4735-8465-25717a78dcb2" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-b97d19f1-b73e-4735-8465-25717a78dcb2" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[403d898c-1d7e-44b9-b3f1-4515da3cde26]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:07 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:08 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2
Feb 27 02:11:08 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:08 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.info" returned: 0 in 0.525s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.291s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.710s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522079548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63f96a2-8989-4a4f-bf7d-20eb218e350d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:01Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Creating volume b63f96a2-8989-4a4f-bf7d-20eb218e350d {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:08 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:08 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d 1073741824
Feb 27 02:11:08 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:08 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9fd59408-1e28-468a-bd04-195939b040a3 tempest-VolumeDependencyTests-361767958 None] Create snapshot completed successfully
Feb 27 02:11:08 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2" returned: 0 in 0.611s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:08 devstack sudo[90303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2
Feb 27 02:11:08 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:08 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d 1073741824" returned: 0 in 0.534s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:08 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:08 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d
Feb 27 02:11:08 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:09 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b97d19f1-b73e-4735-8465-25717a78dcb2" returned: 0 in 0.453s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-b97d19f1-b73e-4735-8465-25717a78dcb2" released by "delete_volume" :: held 1.107s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Created reservations ['ace194cd-23f6-4256-9178-563775bed73f', '54f0812b-aff1-4972-81da-35874415050e', '87b855df-fc3b-4c9b-87e3-2e3dd18c8914', '0edbf849-4ad5-4aff-96f3-b3ed27fde7fa'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:09 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:09 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:09 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d" returned: 0 in 0.433s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.552s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-563803680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64723972-1cc9-46f8-8e6c-3a73f3259c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:02Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Creating volume 64723972-1cc9-46f8-8e6c-3a73f3259c8a {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:09 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48ee88a-7307-476e-ad38-b75dfd469a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:09 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a 1073741824
Feb 27 02:11:09 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e6256d-fbf3-4679-8120-3ac8e558ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:09 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d (b63f96a2-8989-4a4f-bf7d-20eb218e350d): created successfully
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e6256d-fbf3-4679-8120-3ac8e558ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (acdbcc52-44a8-45e2-93b6-3d00b87eb969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:09 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-699a9e6e-d5c9-4c97-9a67-a47cb122946f tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created volume successfully.
Feb 27 02:11:09 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.673s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:09 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Deleted volume successfully.
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d01b983-267d-484a-a8a1-004f3f6cfbc6 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-b97d19f1-b73e-4735-8465-25717a78dcb2-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:09 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Flow 'volume_create_manager' (81823a62-9b97-4619-a2eb-d8db13badea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8284986c-968e-4702-a023-90aa7d98c173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8284986c-968e-4702-a023-90aa7d98c173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2134412185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be0176d-d61a-4435-a130-8ba40b25f082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b32d8e337242deafc1ea25fb129fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6fb24a5-b5ec-4dbe-868a-a9c153eca282,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:10Z,use_quota=True,user_id='98920bf1831346a28e1a66d5cf154482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8cbe61-abed-473a-a53c-bdb016df43c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8cbe61-abed-473a-a53c-bdb016df43c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d728f403-6016-44e3-b047-46fb25f82201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d728f403-6016-44e3-b047-46fb25f82201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2be0176d-d61a-4435-a130-8ba40b25f082', 'volume_name': 'volume-2be0176d-d61a-4435-a130-8ba40b25f082', 'volume_size': 1, 'snapshot_id': 'f6fb24a5-b5ec-4dbe-868a-a9c153eca282'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a58a87-4e4a-45da-a2f7-779d872fe0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a58a87-4e4a-45da-a2f7-779d872fe0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f362155-c5e7-4b9b-8c61-70733291969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:10 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Volume 2be0176d-d61a-4435-a130-8ba40b25f082: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2be0176d-d61a-4435-a130-8ba40b25f082', 'volume_size': 1, 'snapshot_id': 'f6fb24a5-b5ec-4dbe-868a-a9c153eca282'}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-4e9f1a6e-0d50-45ac-8e30-49e71e457e26-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-4e9f1a6e-0d50-45ac-8e30-49e71e457e26-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-quobyte-4e9f1a6e-0d50-45ac-8e30-49e71e457e26" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-4e9f1a6e-0d50-45ac-8e30-49e71e457e26" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad4b81d-1630-48b4-9b2d-5823db839ba9]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:10 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a 1073741824" returned: 0 in 0.857s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:10 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26
Feb 27 02:11:10 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:10 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a
Feb 27 02:11:10 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:10 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26" returned: 0 in 0.566s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:10 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26
Feb 27 02:11:10 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:10 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a" returned: 0 in 0.554s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.751s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-145104940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3477cd74-91d1-4a91-8bec-77f3ac79cc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:02Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Creating volume 3477cd74-91d1-4a91-8bec-77f3ac79cc3b {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:10 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6a49b8-d095-4f69-b792-c4e16d479ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b41be11-3deb-4438-a42d-0a7ec407aee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:10 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a (64723972-1cc9-46f8-8e6c-3a73f3259c8a): created successfully
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b41be11-3deb-4438-a42d-0a7ec407aee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:10 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (f43669af-809c-4446-a5e2-58729000d514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:10 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b 1073741824
Feb 27 02:11:10 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:10 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-70f26e82-2524-472a-a8f4-77e7f86f36e9 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created volume successfully.
Feb 27 02:11:11 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-4e9f1a6e-0d50-45ac-8e30-49e71e457e26" returned: 0 in 0.532s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-4e9f1a6e-0d50-45ac-8e30-49e71e457e26" released by "delete_volume" :: held 1.120s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Created reservations ['41a6c431-271b-418b-9a35-8e585f4462ee', '6e7d7d45-4c65-4d9c-8945-852636c43687', 'd3d9df5a-2cb5-449d-9423-2b49454a6e43', 'f83a1552-d171-4893-a0dc-759733df9290'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:11 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:11 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:11 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b 1073741824" returned: 0 in 0.612s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:11 devstack sudo[90338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b
Feb 27 02:11:11 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:11 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.513s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:11 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Deleted volume successfully.
Feb 27 02:11:11 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-0cccf155-b9eb-4556-bc6d-c43aa2af0ffa tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-4e9f1a6e-0d50-45ac-8e30-49e71e457e26-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:12 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b" returned: 0 in 0.544s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.438s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-655356599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976366c5-d836-4ca4-a328-84afe4b22224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:02Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Creating volume 976366c5-d836-4ca4-a328-84afe4b22224 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:12 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd003bf9-8b1b-4d26-a4aa-39df7194a708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119ae102-f3ac-4c38-a6a9-378dbed48f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:12 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224 1073741824
Feb 27 02:11:12 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:12 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b (3477cd74-91d1-4a91-8bec-77f3ac79cc3b): created successfully
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119ae102-f3ac-4c38-a6a9-378dbed48f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (50d6ab43-8ebe-4d6c-8055-887a2251780f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:12 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-aaf3daad-eb90-4243-97ef-bf452b8f6c2e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created volume successfully.
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-quobyte-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9" acquired by "delete_volume" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc7a748-8202-4cec-acef-47b6ae28a24a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:12 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9
Feb 27 02:11:12 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:12 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224 1073741824" returned: 0 in 0.609s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:12 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224
Feb 27 02:11:12 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:12 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9" returned: 0 in 0.575s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:12 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:12 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9
Feb 27 02:11:12 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:13 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224" returned: 0 in 0.492s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.318s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346240898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dc1d17-3f8d-4171-817f-6facd9422f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa0dbe8b0f094561a38c6ff553ead745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:03Z,use_quota=True,user_id='cf57e0ecbf8e46ffb03f890c7958bd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Creating volume 75dc1d17-3f8d-4171-817f-6facd9422f0a {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:13 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:13 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a 1073741824
Feb 27 02:11:13 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c2b9f7-5c18-496f-af05-88894ae740fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976366c5-d836-4ca4-a328-84afe4b22224', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16216930-f23d-4c65-9679-6f9fb8d21bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:13 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume volume-976366c5-d836-4ca4-a328-84afe4b22224 (976366c5-d836-4ca4-a328-84afe4b22224): created successfully
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16216930-f23d-4c65-9679-6f9fb8d21bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (effffe3f-3945-4544-b5fc-7edffaaadc6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:13 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-d093b80c-cb48-487c-9a67-258d728e8265 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created volume successfully.
Feb 27 02:11:13 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9" returned: 0 in 0.514s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9" released by "delete_volume" :: held 1.145s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Created reservations ['eab31a97-9262-4d59-8c10-947a2e76d22d', 'b3166681-83f7-46c3-9854-0323f56eb058', '538c3397-16da-4cd0-9c74-f0403ec7b208', '411879a3-49bd-4eaf-b33b-1888b3b49f33'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:13 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:13 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:13 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a 1073741824" returned: 0 in 0.645s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:13 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:13 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a
Feb 27 02:11:13 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:14 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.466s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:14 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Deleted volume successfully.
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-6ffaccfd-49fb-4740-8ef9-f0ed8529bd84 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-28c19c94-a3f6-4c56-9d8e-ad3d712f9fb9-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:14 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a" returned: 0 in 0.480s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.233s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-f6fb24a5-b5ec-4dbe-868a-a9c153eca282-2be0176d-d61a-4435-a130-8ba40b25f082" by "_create_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe1d92e-4fe5-45b8-be25-674715150ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75dc1d17-3f8d-4171-817f-6facd9422f0a', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d42772a-dd49-41c6-9cf7-3eac1db15903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-f6fb24a5-b5ec-4dbe-868a-a9c153eca282-2be0176d-d61a-4435-a130-8ba40b25f082" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Creating volume 2be0176d-d61a-4435-a130-8ba40b25f082 from snapshot f6fb24a5-b5ec-4dbe-868a-a9c153eca282 {{(pid=83140) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-2be0176d-d61a-4435-a130-8ba40b25f082" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:14 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Volume volume-75dc1d17-3f8d-4171-817f-6facd9422f0a (75dc1d17-3f8d-4171-817f-6facd9422f0a): created successfully
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d42772a-dd49-41c6-9cf7-3eac1db15903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Flow 'volume_create_manager' (dd3f94ce-47af-4868-b4a8-3c7abada707c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-2be0176d-d61a-4435-a130-8ba40b25f082" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] snapshot: f6fb24a5-b5ec-4dbe-868a-a9c153eca282, volume: 2be0176d-d61a-4435-a130-8ba40b25f082,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:11:14 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ec60d5e2-d9bc-428e-9d3f-a7b22322d24a tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created volume successfully.
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-22738b4c-2b0f-48a5-beb0-4cb70d947bd0-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5964980-6ad8-46ed-86e9-ac3961e5f42b]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-22738b4c-2b0f-48a5-beb0-4cb70d947bd0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "cinder-quobyte-22738b4c-2b0f-48a5-beb0-4cb70d947bd0" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-22738b4c-2b0f-48a5-beb0-4cb70d947bd0" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[331dc042-17f0-4bb5-9d89-8bce5aeb1366]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:14 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282
Feb 27 02:11:14 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-75dc1d17-3f8d-4171-817f-6facd9422f0a-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-75dc1d17-3f8d-4171-817f-6facd9422f0a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:14 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0
Feb 27 02:11:14 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-quobyte-75dc1d17-3f8d-4171-817f-6facd9422f0a" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-75dc1d17-3f8d-4171-817f-6facd9422f0a" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[36663b21-98c5-414c-8421-e4b2ff9496e4]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:14 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:14 devstack sudo[90374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a
Feb 27 02:11:14 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:15 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282" returned: 0 in 0.592s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb488649-3256-4ce8-8491-7c377ccfc2c8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:15 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0" returned: 0 in 0.569s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:15 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0
Feb 27 02:11:15 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:15 devstack sudo[90383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8
Feb 27 02:11:15 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:15 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a" returned: 0 in 0.638s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:15 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a
Feb 27 02:11:15 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Flow 'volume_create_manager' (498f6b13-8761-4f7e-8555-a54da3c7461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4115f7f3-e125-4d1f-930e-d940102a159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4115f7f3-e125-4d1f-930e-d940102a159f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1522688930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24656835-5753-407d-98a5-0393ff131be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3738ec7e126449f9f142ce1c075e253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:15Z,use_quota=True,user_id='ed4afe1773be481fb417902f4bd2e169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb8f7a9-c872-46bf-ae4f-34ad6f6c98be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb8f7a9-c872-46bf-ae4f-34ad6f6c98be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60169d07-ce24-44a6-b0c6-ce1c419fd5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60169d07-ce24-44a6-b0c6-ce1c419fd5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24656835-5753-407d-98a5-0393ff131be9', 'volume_name': 'volume-24656835-5753-407d-98a5-0393ff131be9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794581fd-fb2f-4c83-ac52-d1d0142036a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794581fd-fb2f-4c83-ac52-d1d0142036a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08adf3b5-992e-455e-be49-494f1f8b5089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:15 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Volume 24656835-5753-407d-98a5-0393ff131be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24656835-5753-407d-98a5-0393ff131be9', 'volume_size': 1}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:15 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-22738b4c-2b0f-48a5-beb0-4cb70d947bd0" returned: 0 in 0.486s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-quobyte-22738b4c-2b0f-48a5-beb0-4cb70d947bd0" released by "delete_volume" :: held 1.078s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Created reservations ['ca80e401-9a73-4981-8484-2a1c7fc35ec3', '33c71653-dabb-4f68-ae0b-0fae3e886e35', '12e63e4b-6bcc-483c-8f35-9dc88cd8270e', 'b1a002f1-3852-4156-8a80-c154aa9c4faa'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:15 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8" returned: 0 in 0.632s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:15 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:15 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:15 devstack sudo[90397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082
Feb 27 02:11:15 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:15 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-75dc1d17-3f8d-4171-817f-6facd9422f0a" returned: 0 in 0.456s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-75dc1d17-3f8d-4171-817f-6facd9422f0a" released by "delete_volume" :: held 1.118s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created reservations ['2087fba4-ccb8-411c-ad58-2a29e4463093', 'c4d9738d-1f6e-4d99-9149-0342dc3f5af1', '8ffee614-95f3-4d6b-b291-5ca7d3080468', '391af5db-5703-4a7b-8174-97a29b14e75e'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:15 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:15 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:15 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:16 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.687s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:16 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:16 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Deleted volume successfully.
Feb 27 02:11:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5d58d732-f18e-48f0-bb31-3c41ff7e3a73 tempest-CreateVolumesFromImageTest-1172888740 None] Lock "cinder-22738b4c-2b0f-48a5-beb0-4cb70d947bd0-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:16 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:16 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.683s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:16 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:16 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Deleted volume successfully.
Feb 27 02:11:16 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-467d446d-6f9d-4ed5-b7e1-93bb3490610e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-75dc1d17-3f8d-4171-817f-6facd9422f0a-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-976366c5-d836-4ca4-a328-84afe4b22224-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-976366c5-d836-4ca4-a328-84afe4b22224-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-quobyte-976366c5-d836-4ca4-a328-84afe4b22224" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:17 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-976366c5-d836-4ca4-a328-84afe4b22224" acquired by "delete_volume" :: waited 0.022s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:17 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fef19f-4257-4d73-9739-c42808d2d1ee]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:17 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:17 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224
Feb 27 02:11:17 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:18 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082" returned: 0 in 2.627s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:18 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c98cf2-7eb3-4255-80a6-dbe42c88827a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:18 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8
Feb 27 02:11:18 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:18 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224" returned: 0 in 1.267s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:18 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224
Feb 27 02:11:18 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:18 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:18 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-976366c5-d836-4ca4-a328-84afe4b22224" returned: 0 in 0.447s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:18 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-976366c5-d836-4ca4-a328-84afe4b22224" released by "delete_volume" :: held 1.761s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:18 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created reservations ['a8c3e135-fe5c-4c9a-ae63-b93b5af2ca77', '417b24f2-96d5-4437-9cd4-70585a263f13', '2065fcef-3ca0-4eb7-8ed0-30d8513dca1d', '87c07e4e-fc8c-49ae-98ab-52e125df058e'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:19 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8" returned: 0 in 0.666s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8, size 1024.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:11:19 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Converted 1024.00 MB image at 389.56 MB/s
Feb 27 02:11:19 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082 is being set with open permissions: ugo+rw
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:19 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:19 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:19 devstack sudo[90429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082
Feb 27 02:11:19 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-3477cd74-91d1-4a91-8bec-77f3ac79cc3b-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-3477cd74-91d1-4a91-8bec-77f3ac79cc3b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-quobyte-3477cd74-91d1-4a91-8bec-77f3ac79cc3b" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-3477cd74-91d1-4a91-8bec-77f3ac79cc3b" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[936e48e2-e128-4e25-b917-793387e05c45]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:19 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082" returned: 0 in 0.452s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-2be0176d-d61a-4435-a130-8ba40b25f082" released by "_copy_volume_from_snapshot" :: held 5.081s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-f6fb24a5-b5ec-4dbe-868a-a9c153eca282-2be0176d-d61a-4435-a130-8ba40b25f082" released by "_create_volume_from_snapshot" :: held 5.118s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.142s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.923s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1522688930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24656835-5753-407d-98a5-0393ff131be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3738ec7e126449f9f142ce1c075e253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:15Z,use_quota=True,user_id='ed4afe1773be481fb417902f4bd2e169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Creating volume 24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:19 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:19 devstack sudo[90434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b
Feb 27 02:11:19 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f362155-c5e7-4b9b-8c61-70733291969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be0176d-d61a-4435-a130-8ba40b25f082', 'volume_size': 1, 'snapshot_id': 'f6fb24a5-b5ec-4dbe-868a-a9c153eca282'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e24b2d0-9304-4e13-9668-7b9cbb24d550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:19 devstack sudo[90435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 1073741824
Feb 27 02:11:19 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:19 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.567s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Volume volume-2be0176d-d61a-4435-a130-8ba40b25f082 (2be0176d-d61a-4435-a130-8ba40b25f082): created successfully
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e24b2d0-9304-4e13-9668-7b9cbb24d550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Flow 'volume_create_manager' (81823a62-9b97-4619-a2eb-d8db13badea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Deleted volume successfully.
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-72981136-52d9-449a-bbef-534f8d7b056b tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-976366c5-d836-4ca4-a328-84afe4b22224-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:19 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-b496bf5f-78ff-444e-aa88-e0ba3b152103 tempest-VolumeDependencyTests-361767958 None] Created volume successfully.
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (94b1e270-2e6b-4c4f-b1eb-5856d1ec53fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556a0e95-2259-48e5-9a94-a0f7d5c63051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556a0e95-2259-48e5-9a94-a0f7d5c63051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298003401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9548d495-af3e-4265-94f4-b4fd15e3d369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:20Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55cd9caa-e09d-44ff-8d2e-db8ac56a20dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55cd9caa-e09d-44ff-8d2e-db8ac56a20dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae43cee-5c37-46a3-bdca-2d2bdf4f0d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae43cee-5c37-46a3-bdca-2d2bdf4f0d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9548d495-af3e-4265-94f4-b4fd15e3d369', 'volume_name': 'volume-9548d495-af3e-4265-94f4-b4fd15e3d369', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961bd4f4-7c29-4ffb-b821-c22d1d9d2530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961bd4f4-7c29-4ffb-b821-c22d1d9d2530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c33481-88d9-42f5-9802-4921736aae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:19 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume 9548d495-af3e-4265-94f4-b4fd15e3d369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9548d495-af3e-4265-94f4-b4fd15e3d369', 'volume_size': 1}
Feb 27 02:11:19 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:20 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b" returned: 0 in 0.562s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:20 devstack sudo[90444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b
Feb 27 02:11:20 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:20 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 1073741824" returned: 0 in 0.532s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:20 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9
Feb 27 02:11:20 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:20 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-3477cd74-91d1-4a91-8bec-77f3ac79cc3b" returned: 0 in 0.424s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-3477cd74-91d1-4a91-8bec-77f3ac79cc3b" released by "delete_volume" :: held 1.024s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created reservations ['1689b6ed-519b-4a55-86a3-cd5c4b93a504', '98b576dc-7e66-4ad5-9221-d78d42535440', 'a9d0ac78-be39-4d5b-a614-b6a015ffff6c', '2b9fae19-ffc8-4391-8df1-2c41cdcc85bc'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:20 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9" returned: 0 in 0.433s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1298003401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9548d495-af3e-4265-94f4-b4fd15e3d369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:20Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Creating volume 9548d495-af3e-4265-94f4-b4fd15e3d369 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:20 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08adf3b5-992e-455e-be49-494f1f8b5089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24656835-5753-407d-98a5-0393ff131be9', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5995059f-af67-472b-8465-7c5ff1f89309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:20 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369 1073741824
Feb 27 02:11:20 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:20 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Volume volume-24656835-5753-407d-98a5-0393ff131be9 (24656835-5753-407d-98a5-0393ff131be9): created successfully
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5995059f-af67-472b-8465-7c5ff1f89309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Flow 'volume_create_manager' (498f6b13-8761-4f7e-8555-a54da3c7461e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:20 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-af37d4f9-daf7-4350-92ad-37fbb94a487a tempest-SnapshotDependencyTests-1696278284 None] Created volume successfully.
Feb 27 02:11:20 devstack sudo[90452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:20 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-f6fb24a5-b5ec-4dbe-868a-a9c153eca282-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-f6fb24a5-b5ec-4dbe-868a-a9c153eca282-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-e21fe079-9557-4e4f-a302-f42aaca4f1f8" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-e21fe079-9557-4e4f-a302-f42aaca4f1f8" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-f6fb24a5-b5ec-4dbe-868a-a9c153eca282" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-f6fb24a5-b5ec-4dbe-868a-a9c153eca282" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Deleting offline snapshot f6fb24a5-b5ec-4dbe-868a-a9c153eca282 of volume e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] snapshot_file for this snap is: volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[680fb786-aacd-45a9-a6a0-efefe60b8c10]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:20 devstack sudo[90454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282
Feb 27 02:11:20 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:21 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:21 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369 1073741824" returned: 0 in 0.535s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.472s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:21 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Deleted volume successfully.
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9b473b92-c4fa-464c-8518-ce1fda4fcc0e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-3477cd74-91d1-4a91-8bec-77f3ac79cc3b-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:21 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369
Feb 27 02:11:21 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:21 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282" returned: 0 in 0.533s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[32db070f-fe77-4988-bd58-c1c30f032c6d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:21 devstack sudo[90465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8
Feb 27 02:11:21 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:21 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369" returned: 0 in 0.420s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.353s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Creating offline snapshot 233b6843-4be1-4825-bc62-847b46c61431 of volume 24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c33481-88d9-42f5-9802-4921736aae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9548d495-af3e-4265-94f4-b4fd15e3d369', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28d60f5-2a80-4ff4-ac85-cd6d92cfd6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f26bffe-29e4-4a67-abef-d4fe8fbbb95e]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-64723972-1cc9-46f8-8e6c-3a73f3259c8a-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:21 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume volume-9548d495-af3e-4265-94f4-b4fd15e3d369 (9548d495-af3e-4265-94f4-b4fd15e3d369): created successfully
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28d60f5-2a80-4ff4-ac85-cd6d92cfd6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (94b1e270-2e6b-4c4f-b1eb-5856d1ec53fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:21 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7103ca3a-91fb-4897-8b8c-642527259d14 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created volume successfully.
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-64723972-1cc9-46f8-8e6c-3a73f3259c8a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-quobyte-64723972-1cc9-46f8-8e6c-3a73f3259c8a" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-64723972-1cc9-46f8-8e6c-3a73f3259c8a" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a86c604-081e-46bc-89de-e5b5bdf21333]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:21 devstack sudo[90468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9
Feb 27 02:11:21 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:21 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8" returned: 0 in 0.476s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:21 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282
Feb 27 02:11:21 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:21 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a
Feb 27 02:11:21 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:22 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9" returned: 0 in 0.562s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:22 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 1G
Feb 27 02:11:22 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:22 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282" returned: 0 in 0.486s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:22 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282
Feb 27 02:11:22 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:22 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a" returned: 0 in 0.582s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:22 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a
Feb 27 02:11:22 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:22 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 1G" returned: 0 in 0.499s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24656835-5753-407d-98a5-0393ff131be9 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:22 devstack sudo[90497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24656835-5753-407d-98a5-0393ff131be9 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431
Feb 27 02:11:22 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:22 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-64723972-1cc9-46f8-8e6c-3a73f3259c8a" returned: 0 in 0.412s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:22 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8.f6fb24a5-b5ec-4dbe-868a-a9c153eca282" returned: 0 in 0.468s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-64723972-1cc9-46f8-8e6c-3a73f3259c8a" released by "delete_volume" :: held 1.019s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-f6fb24a5-b5ec-4dbe-868a-a9c153eca282" released by "_delete_snapshot" :: held 2.051s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-e21fe079-9557-4e4f-a302-f42aaca4f1f8" released by "delete_snapshot" :: held 2.068s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created reservations ['7af79da3-aa87-4872-92ec-f87990ca6378', '678d48ce-2826-41b9-96e1-c64b270eef8c', '3941b3e4-a3f1-48d8-b760-e14105846d85', 'd2a15896-13e1-46be-bb25-83b87ee3f339'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Created reservations ['25cf444d-f85b-46f5-a893-cb01ccb915df', '8ef03d7a-60d7-4649-a5ae-d984e3ed491e', 'a07883b7-1b58-4b52-898f-04c8284ea93e', '1a2ce143-7339-4a78-a69a-6d24fcd33000'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:22 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:22 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:22 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Delete snapshot completed successfully.
Feb 27 02:11:22 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8412e0d0-d8fc-4ba8-975a-40d0701ba194 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-f6fb24a5-b5ec-4dbe-868a-a9c153eca282-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:23 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24656835-5753-407d-98a5-0393ff131be9 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431" returned: 0 in 0.464s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:23 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 is being set with open permissions: ugo+rw
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:23 devstack sudo[90505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431
Feb 27 02:11:23 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:23 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.413s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:23 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Deleted volume successfully.
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9f8d40cf-e016-44fd-8b14-5cf2a36ec36e tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-64723972-1cc9-46f8-8e6c-3a73f3259c8a-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:23 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431" returned: 0 in 0.383s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:23 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.info
Feb 27 02:11:23 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-b63f96a2-8989-4a4f-bf7d-20eb218e350d-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-b63f96a2-8989-4a4f-bf7d-20eb218e350d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-e21fe079-9557-4e4f-a302-f42aaca4f1f8-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-quobyte-b63f96a2-8989-4a4f-bf7d-20eb218e350d" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-e21fe079-9557-4e4f-a302-f42aaca4f1f8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-b63f96a2-8989-4a4f-bf7d-20eb218e350d" acquired by "delete_volume" :: waited 0.017s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-e21fe079-9557-4e4f-a302-f42aaca4f1f8" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d13ab7f-d91f-4af7-912b-05c6cbaeb961]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-e21fe079-9557-4e4f-a302-f42aaca4f1f8" acquired by "delete_volume" :: waited 0.018s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[748cfe33-a6a9-411c-ae4f-55f186182afa]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:23 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:23 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.info" returned: 0 in 0.472s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:24 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.info is being set with open permissions: ugo+rw
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:24 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d
Feb 27 02:11:24 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:24 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.info
Feb 27 02:11:24 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:24 devstack sudo[90513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8
Feb 27 02:11:24 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:24 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d" returned: 0 in 0.505s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:24 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8" returned: 0 in 0.487s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:24 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d
Feb 27 02:11:24 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:24 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.info" returned: 0 in 0.450s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.909s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:24 devstack sudo[90526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8
Feb 27 02:11:24 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.483s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Creating offline snapshot a05ee5c4-500c-448b-8101-e06377bd2164 of volume 9548d495-af3e-4265-94f4-b4fd15e3d369 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c811daa-3687-4d5c-a5af-9f2fbc0794e4]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:24 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-2acc798e-f259-46ea-ab94-3ae186897f23 tempest-SnapshotDependencyTests-1696278284 None] Create snapshot completed successfully
Feb 27 02:11:24 devstack sudo[90529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369
Feb 27 02:11:24 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:24 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-b63f96a2-8989-4a4f-bf7d-20eb218e350d" returned: 0 in 0.407s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-b63f96a2-8989-4a4f-bf7d-20eb218e350d" released by "delete_volume" :: held 0.942s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:24 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-e21fe079-9557-4e4f-a302-f42aaca4f1f8" returned: 0 in 0.427s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created reservations ['67dbc6aa-6844-42df-9798-6b4dee0215bb', '4709e0cb-66e5-409e-932a-60975b9ada32', 'b489c6a9-1e96-4d38-a481-bc3564487736', 'ff4e1410-8ca4-4c9d-8e37-736372247215'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-e21fe079-9557-4e4f-a302-f42aaca4f1f8" released by "delete_volume" :: held 0.953s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Created reservations ['04fd2f35-d5ff-47b8-a46f-c5ab4682bbdd', '84da813b-aeab-4699-ae8b-bc9716c385b9', 'b220f5ee-e70d-4d89-b08c-ca8c60835ba7', '1ebe9317-7455-403a-ad9f-d0f2e60d3d11'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:24 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-99f3027f-a5b4-480a-90ff-4cdff561a623-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:24 devstack sudo[90536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:24 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-99f3027f-a5b4-480a-90ff-4cdff561a623-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:25 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369" returned: 0 in 0.530s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:25 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 1G
Feb 27 02:11:25 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "cinder-quobyte-99f3027f-a5b4-480a-90ff-4cdff561a623" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-99f3027f-a5b4-480a-90ff-4cdff561a623" acquired by "delete_volume" :: waited 0.025s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7c3cd9-d088-4cf1-9055-628573d914a8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:25 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:25 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:25 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623
Feb 27 02:11:25 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:25 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.470s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:25 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Deleted volume successfully.
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-3bd5d4db-a577-4514-ad88-6419904dcae1 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-b63f96a2-8989-4a4f-bf7d-20eb218e350d-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:25 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.454s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:25 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Deleted volume successfully.
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-88f897b0-9416-44c1-8873-93a228c27857 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-e21fe079-9557-4e4f-a302-f42aaca4f1f8-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:25 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 1G" returned: 0 in 0.590s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:25 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9548d495-af3e-4265-94f4-b4fd15e3d369 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623" returned: 0 in 0.516s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:25 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9548d495-af3e-4265-94f4-b4fd15e3d369 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164
Feb 27 02:11:25 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:25 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623
Feb 27 02:11:25 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:DELETE=16,cinder:SELECT=148,cinder:INSERT=46,cinder:UPDATE=175 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Flow 'volume_create_manager' (33b859e9-2847-4d19-a872-b97319dfe093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953f2739-80f3-482c-aea7-32db6eee9d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953f2739-80f3-482c-aea7-32db6eee9d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6bb343-1f69-47e2-8b0c-d48e92f24408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3738ec7e126449f9f142ce1c075e253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=233b6843-4be1-4825-bc62-847b46c61431,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:26Z,use_quota=True,user_id='ed4afe1773be481fb417902f4bd2e169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663747ae-b8de-4aef-94bd-65a27bf45acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663747ae-b8de-4aef-94bd-65a27bf45acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f091a5-5345-4384-b4a6-370514d90bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f091a5-5345-4384-b4a6-370514d90bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa6bb343-1f69-47e2-8b0c-d48e92f24408', 'volume_name': 'volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408', 'volume_size': 1, 'snapshot_id': '233b6843-4be1-4825-bc62-847b46c61431'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91c48ef-976b-4f6d-846e-20edc643c621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91c48ef-976b-4f6d-846e-20edc643c621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b32fac-3c35-4ea4-b124-7b05a62d62b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:25 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Volume aa6bb343-1f69-47e2-8b0c-d48e92f24408: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408', 'volume_size': 1, 'snapshot_id': '233b6843-4be1-4825-bc62-847b46c61431'}
Feb 27 02:11:25 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:26 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:26 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-99f3027f-a5b4-480a-90ff-4cdff561a623" returned: 0 in 0.441s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9548d495-af3e-4265-94f4-b4fd15e3d369 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164" returned: 0 in 0.454s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:26 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 is being set with open permissions: ugo+rw
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-quobyte-99f3027f-a5b4-480a-90ff-4cdff561a623" released by "delete_volume" :: held 0.987s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:26 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164
Feb 27 02:11:26 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Created reservations ['26104357-ef48-44bd-b0ea-9760970215db', '5128f964-f63f-40eb-9f5c-59a86de80de8', 'ac89e124-92b9-4cbc-a43f-739c3d4f9ee2', '1240e4d1-c1e9-4012-bb24-ca9a28d83297'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:26 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:26 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Flow 'volume_create_manager' (8da5d0c0-b2c5-4e87-a27b-17db18a71eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9538d783-79c3-4028-838a-12f6cd188412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9538d783-79c3-4028-838a-12f6cd188412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-897293533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c47c33e-7994-4caa-b0b7-98a023c8032c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b32d8e337242deafc1ea25fb129fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:26Z,use_quota=True,user_id='98920bf1831346a28e1a66d5cf154482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e68fba-31a8-4afb-b408-65dbdc85c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e68fba-31a8-4afb-b408-65dbdc85c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeeecaf-2148-4954-a502-fa16773517bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeeecaf-2148-4954-a502-fa16773517bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c47c33e-7994-4caa-b0b7-98a023c8032c', 'volume_name': 'volume-2c47c33e-7994-4caa-b0b7-98a023c8032c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e69a61-6580-4570-9502-88049d8f8528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e69a61-6580-4570-9502-88049d8f8528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e926ed1d-c7e4-4b03-847b-48f1eee7ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:26 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Volume 2c47c33e-7994-4caa-b0b7-98a023c8032c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c47c33e-7994-4caa-b0b7-98a023c8032c', 'volume_size': 1}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:26 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164" returned: 0 in 0.445s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:26 devstack sudo[90566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.info
Feb 27 02:11:26 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:26 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.396s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:26 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Deleted volume successfully.
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ae38dc51-c78d-40a6-940c-adcfa552e3a6 tempest-CreateVolumesFromSourceVolumeTest-760258010 None] Lock "cinder-99f3027f-a5b4-480a-90ff-4cdff561a623-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:26 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.info" returned: 0 in 0.390s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:26 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.info is being set with open permissions: ugo+rw
Feb 27 02:11:26 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:26 devstack sudo[90569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.info
Feb 27 02:11:26 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:27 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.info" returned: 0 in 0.406s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.869s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.491s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "cinder-quobyte-233b6843-4be1-4825-bc62-847b46c61431-aa6bb343-1f69-47e2-8b0c-d48e92f24408" by "_create_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:27 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-17cbb501-7902-4dd1-a408-1a399edff342 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Create snapshot completed successfully
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-233b6843-4be1-4825-bc62-847b46c61431-aa6bb343-1f69-47e2-8b0c-d48e92f24408" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Creating volume aa6bb343-1f69-47e2-8b0c-d48e92f24408 from snapshot 233b6843-4be1-4825-bc62-847b46c61431 {{(pid=83140) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "cinder-quobyte-aa6bb343-1f69-47e2-8b0c-d48e92f24408" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-aa6bb343-1f69-47e2-8b0c-d48e92f24408" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] snapshot: 233b6843-4be1-4825-bc62-847b46c61431, volume: aa6bb343-1f69-47e2-8b0c-d48e92f24408,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884d08e-e4e4-4227-bd96-ff7abf62d6cb]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:27 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431
Feb 27 02:11:27 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:27 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431" returned: 0 in 0.560s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24656835-5753-407d-98a5-0393ff131be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d67c88-29da-43bf-9fb5-e61442c6913d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:27 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:28 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9
Feb 27 02:11:28 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (8130fbb5-a028-46ec-a099-234e985cdc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30c6adc-3405-46a0-8df1-f5e08b66a75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30c6adc-3405-46a0-8df1-f5e08b66a75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2020034993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:28Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36528084-eeb8-422a-a347-6b851b29f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36528084-eeb8-422a-a347-6b851b29f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdc0401-9f68-4253-aaae-b304a0bbfc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdc0401-9f68-4253-aaae-b304a0bbfc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e', 'volume_name': 'volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14aa24f7-5dc1-4192-a692-a3b76cb2f3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14aa24f7-5dc1-4192-a692-a3b76cb2f3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6372eeef-ac54-466b-9492-1a95c4a4eae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume 9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e', 'volume_size': 1}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:28 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9" returned: 0 in 0.590s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:28 devstack sudo[90582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408
Feb 27 02:11:28 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (6ae5ef65-80d3-4ad0-97c7-47a60d631ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdeac1a-c2f0-4e23-9a29-0727b9241609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdeac1a-c2f0-4e23-9a29-0727b9241609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-164871094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00895fa1-e296-43fd-acb4-9001c646f1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826c6219-79f1-40e2-9ffe-47d43c62c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826c6219-79f1-40e2-9ffe-47d43c62c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35479f6a-7c2d-4ddc-9ff9-d9ab2abbb612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35479f6a-7c2d-4ddc-9ff9-d9ab2abbb612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00895fa1-e296-43fd-acb4-9001c646f1f0', 'volume_name': 'volume-00895fa1-e296-43fd-acb4-9001c646f1f0', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116923b1-31d5-42a8-a2f0-d424ec10bba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116923b1-31d5-42a8-a2f0-d424ec10bba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60b4762-de43-4fcc-b4d7-446967e65c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:28 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume 00895fa1-e296-43fd-acb4-9001c646f1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00895fa1-e296-43fd-acb4-9001c646f1f0', 'volume_size': 1}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:28 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (973cf916-0845-4aa1-8b0f-52d47449477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0199cbd-8101-4618-a22e-1dbe7dd4fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0199cbd-8101-4618-a22e-1dbe7dd4fabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1218515449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11bf286a-9946-4cd4-9d0f-2182ad8ef42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4617e817-d6b8-43b4-bbe7-058d7d479dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4617e817-d6b8-43b4-bbe7-058d7d479dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741ae764-9bb1-473c-a232-f0a80aab93da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741ae764-9bb1-473c-a232-f0a80aab93da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11bf286a-9946-4cd4-9d0f-2182ad8ef42f', 'volume_name': 'volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f639a1-3a48-4136-8288-d3ee1c15b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f639a1-3a48-4136-8288-d3ee1c15b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d31995-ea1f-4953-a7fc-6e5ca2692ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume 11bf286a-9946-4cd4-9d0f-2182ad8ef42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f', 'volume_size': 1}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Flow 'volume_create_manager' (12e1c57f-f20b-4a05-97c5-27e92a235e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8690af2-2d8b-4896-a74b-7fc463501323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8690af2-2d8b-4896-a74b-7fc463501323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fb3527-bb35-4438-8fa8-6da0ef9c62fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6580877eab964ad5b87b05693b001a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='45512663ecc24825b8e4ad989d9ea25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e23e584-34af-4933-9f24-ea59ae6a4848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e23e584-34af-4933-9f24-ea59ae6a4848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b64f77-d898-4997-89bc-0d234f61bd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b64f77-d898-4997-89bc-0d234f61bd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fb3527-bb35-4438-8fa8-6da0ef9c62fe', 'volume_name': 'volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ceed99-cda5-4889-b08b-7490e52f2729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ceed99-cda5-4889-b08b-7490e52f2729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479ff59c-72e2-4ddb-a773-08231bc7ea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Volume 94fb3527-bb35-4438-8fa8-6da0ef9c62fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe', 'volume_size': 1}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (e1771928-a1d8-4910-b79d-74df3b89fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38aa6eb0-db96-46c0-8a05-ea0768b211db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38aa6eb0-db96-46c0-8a05-ea0768b211db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532949174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f771d1bc-8054-408b-a44b-95fb49ae2426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d72cfc7-9ced-4c4d-af9b-daca10806e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d72cfc7-9ced-4c4d-af9b-daca10806e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4e0af1-58f9-41e3-95c1-51ee913c92bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4e0af1-58f9-41e3-95c1-51ee913c92bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f771d1bc-8054-408b-a44b-95fb49ae2426', 'volume_name': 'volume-f771d1bc-8054-408b-a44b-95fb49ae2426', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3257886f-2c88-405d-9fe8-bbbafd12d066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3257886f-2c88-405d-9fe8-bbbafd12d066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5beb4e-adc0-4118-bf16-d94ee2cb1235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:29 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume f771d1bc-8054-408b-a44b-95fb49ae2426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f771d1bc-8054-408b-a44b-95fb49ae2426', 'volume_size': 1}
Feb 27 02:11:29 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (de65a610-2006-4cc5-931a-523e0df87020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302e04bb-93a5-4467-a915-dd07a7695c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302e04bb-93a5-4467-a915-dd07a7695c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1717380048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dce8ea-ff01-42b1-8680-8a5ef7830d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:31Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf10f698-8885-4b00-a3dc-8a250fb1a8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf10f698-8885-4b00-a3dc-8a250fb1a8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47591eb8-97ab-46a1-9a4f-4006a93a9050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47591eb8-97ab-46a1-9a4f-4006a93a9050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57dce8ea-ff01-42b1-8680-8a5ef7830d5b', 'volume_name': 'volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5b65c9-c01b-40c3-9115-c93dc64835bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5b65c9-c01b-40c3-9115-c93dc64835bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a2b103-7f84-4a72-9f38-b79bde9304cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:30 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume 57dce8ea-ff01-42b1-8680-8a5ef7830d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b', 'volume_size': 1}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:30 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408" returned: 0 in 2.104s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdcbb76-8851-4566-afad-570b854966f1]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:30 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:30 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9
Feb 27 02:11:30 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:31 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9" returned: 0 in 0.584s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:11:31 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Converted 1024.00 MB image at 486.62 MB/s
Feb 27 02:11:31 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408 is being set with open permissions: ugo+rw
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:31 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408
Feb 27 02:11:31 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:31 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408" returned: 0 in 0.414s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-aa6bb343-1f69-47e2-8b0c-d48e92f24408" released by "_copy_volume_from_snapshot" :: held 4.315s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-233b6843-4be1-4825-bc62-847b46c61431-aa6bb343-1f69-47e2-8b0c-d48e92f24408" released by "_create_volume_from_snapshot" :: held 4.340s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.368s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.351s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-897293533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c47c33e-7994-4caa-b0b7-98a023c8032c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b32d8e337242deafc1ea25fb129fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:26Z,use_quota=True,user_id='98920bf1831346a28e1a66d5cf154482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Creating volume 2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:31 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:31 devstack sudo[90607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c 1073741824
Feb 27 02:11:31 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b32fac-3c35-4ea4-b124-7b05a62d62b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408', 'volume_size': 1, 'snapshot_id': '233b6843-4be1-4825-bc62-847b46c61431'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fb0265-5b9b-4d5a-b233-f48b2c65f8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:INSERT=43,cinder:SELECT=129,cinder:UPDATE=208,cinder:DELETE=19 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:11:31 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Volume volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408 (aa6bb343-1f69-47e2-8b0c-d48e92f24408): created successfully
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fb0265-5b9b-4d5a-b233-f48b2c65f8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:31 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Flow 'volume_create_manager' (33b859e9-2847-4d19-a872-b97319dfe093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:31 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9ce2526d-dd8f-44a1-815d-b86ac7be20a0 tempest-SnapshotDependencyTests-1696278284 None] Created volume successfully.
Feb 27 02:11:32 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c 1073741824" returned: 0 in 0.511s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:32 devstack sudo[90612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c
Feb 27 02:11:32 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "cinder-233b6843-4be1-4825-bc62-847b46c61431-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-233b6843-4be1-4825-bc62-847b46c61431-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "cinder-quobyte-24656835-5753-407d-98a5-0393ff131be9" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-24656835-5753-407d-98a5-0393ff131be9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "cinder-quobyte-233b6843-4be1-4825-bc62-847b46c61431" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-233b6843-4be1-4825-bc62-847b46c61431" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Deleting offline snapshot 233b6843-4be1-4825-bc62-847b46c61431 of volume 24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] snapshot_file for this snap is: volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9dbf53-7f21-4fc3-a6fe-f3efff9ba626]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:32 devstack sudo[90614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431
Feb 27 02:11:32 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:32 devstack sudo[90617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:32 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:32 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c" returned: 0 in 0.425s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.138s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2020034993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:28Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Creating volume 9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:32 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e926ed1d-c7e4-4b03-847b-48f1eee7ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c47c33e-7994-4caa-b0b7-98a023c8032c', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee45f1f-144f-445c-86d3-322e034910cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:32 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e 1073741824
Feb 27 02:11:32 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:32 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Volume volume-2c47c33e-7994-4caa-b0b7-98a023c8032c (2c47c33e-7994-4caa-b0b7-98a023c8032c): created successfully
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee45f1f-144f-445c-86d3-322e034910cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Flow 'volume_create_manager' (8da5d0c0-b2c5-4e87-a27b-17db18a71eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:32 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-c0235abf-e58c-448a-bc46-82e7714361af tempest-VolumeDependencyTests-361767958 None] Created volume successfully.
Feb 27 02:11:32 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431" returned: 0 in 0.544s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24656835-5753-407d-98a5-0393ff131be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[620aa015-ccff-4b6f-b6bd-8882dccec9df]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:32 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:32 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9
Feb 27 02:11:32 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:33 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.448s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-5971a8e9-d3a9-4eb9-a628-18e2d75eb141 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:33 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e 1073741824" returned: 0 in 0.502s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:33 devstack sudo[90631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e
Feb 27 02:11:33 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:33 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9" returned: 0 in 0.503s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:33 devstack sudo[90636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431
Feb 27 02:11:33 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:33 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e" returned: 0 in 0.384s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.807s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-164871094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00895fa1-e296-43fd-acb4-9001c646f1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Creating volume 00895fa1-e296-43fd-acb4-9001c646f1f0 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:33 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6372eeef-ac54-466b-9492-1a95c4a4eae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:33 devstack sudo[90639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0 1073741824
Feb 27 02:11:33 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc627c2-9541-409a-8ebc-e171ed2ed16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:33 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e (9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e): created successfully
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc627c2-9541-409a-8ebc-e171ed2ed16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (8130fbb5-a028-46ec-a099-234e985cdc6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:33 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3cb176ab-0adb-48b0-b04e-1d2e2d97b6a8 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created volume successfully.
Feb 27 02:11:33 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431" returned: 0 in 0.478s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:33 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:33 devstack sudo[90644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431
Feb 27 02:11:33 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Flow 'volume_create_manager' (c6dfb794-145e-417e-a5b9-a6fe22fe3539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979e1bfa-13f2-4894-b02d-54a6e3c7bf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979e1bfa-13f2-4894-b02d-54a6e3c7bf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-891042664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df79047-cc71-4f85-a599-eee9251dcf19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b32d8e337242deafc1ea25fb129fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2c47c33e-7994-4caa-b0b7-98a023c8032c,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:34Z,use_quota=True,user_id='98920bf1831346a28e1a66d5cf154482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602bc804-3257-43b6-9efe-dc8b482aec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602bc804-3257-43b6-9efe-dc8b482aec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eede5351-9eac-421b-b07f-498ef60542e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eede5351-9eac-421b-b07f-498ef60542e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5df79047-cc71-4f85-a599-eee9251dcf19', 'volume_name': 'volume-5df79047-cc71-4f85-a599-eee9251dcf19', 'volume_size': 1, 'source_volid': '2c47c33e-7994-4caa-b0b7-98a023c8032c', 'source_volstatus': 'available'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d91633b-1124-4d35-8d7d-e10d97b27f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d91633b-1124-4d35-8d7d-e10d97b27f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941107d0-159e-4647-9365-977e7a79d5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:34 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Volume 5df79047-cc71-4f85-a599-eee9251dcf19: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5df79047-cc71-4f85-a599-eee9251dcf19', 'volume_size': 1, 'source_volid': '2c47c33e-7994-4caa-b0b7-98a023c8032c', 'source_volstatus': 'available'}
Feb 27 02:11:34 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0 1073741824" returned: 0 in 0.621s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:34 devstack sudo[90649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0
Feb 27 02:11:34 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:34 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9.233b6843-4be1-4825-bc62-847b46c61431" returned: 0 in 0.480s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-233b6843-4be1-4825-bc62-847b46c61431" released by "_delete_snapshot" :: held 2.064s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-24656835-5753-407d-98a5-0393ff131be9" released by "delete_snapshot" :: held 2.086s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Created reservations ['f1848192-8e74-4fce-87f1-72ccd3b48d2c', '1eda11bb-76ff-402d-bb13-7571166e8e43', 'f73fa924-d449-492c-ae6f-b4d6df56f03c', 'edb1bfe0-a7f5-434a-9abf-fff2467d05b9'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:34 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Delete snapshot completed successfully.
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-e66d4907-67ce-48f1-8b8e-89d188050257 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-233b6843-4be1-4825-bc62-847b46c61431-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:34 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0" returned: 0 in 0.483s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.626s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1218515449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11bf286a-9946-4cd4-9d0f-2182ad8ef42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Creating volume 11bf286a-9946-4cd4-9d0f-2182ad8ef42f {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:34 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:34 devstack sudo[90653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f 1073741824
Feb 27 02:11:34 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60b4762-de43-4fcc-b4d7-446967e65c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00895fa1-e296-43fd-acb4-9001c646f1f0', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963cab73-ffef-46ad-acf1-78848bf6b77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:34 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume volume-00895fa1-e296-43fd-acb4-9001c646f1f0 (00895fa1-e296-43fd-acb4-9001c646f1f0): created successfully
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963cab73-ffef-46ad-acf1-78848bf6b77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:34 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (6ae5ef65-80d3-4ad0-97c7-47a60d631ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:34 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-3fe28b43-1cbf-4aae-8491-1bc2c4868a6a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created volume successfully.
Feb 27 02:11:35 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f 1073741824" returned: 0 in 0.494s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:35 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f
Feb 27 02:11:35 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "cinder-24656835-5753-407d-98a5-0393ff131be9-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-24656835-5753-407d-98a5-0393ff131be9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "cinder-quobyte-24656835-5753-407d-98a5-0393ff131be9" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-24656835-5753-407d-98a5-0393ff131be9" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f483245-79e8-473d-b9d3-144b5bf0d093]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:35 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9
Feb 27 02:11:35 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:35 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f" returned: 0 in 0.402s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.363s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fb3527-bb35-4438-8fa8-6da0ef9c62fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6580877eab964ad5b87b05693b001a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='45512663ecc24825b8e4ad989d9ea25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Creating volume 94fb3527-bb35-4438-8fa8-6da0ef9c62fe {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:35 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d31995-ea1f-4953-a7fc-6e5ca2692ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ff4166-94a2-442b-8662-9dbb2ea79b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:35 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe 1073741824
Feb 27 02:11:35 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:35 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f (11bf286a-9946-4cd4-9d0f-2182ad8ef42f): created successfully
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ff4166-94a2-442b-8662-9dbb2ea79b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:35 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (973cf916-0845-4aa1-8b0f-52d47449477f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:35 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-231ce998-3c0e-44d8-96f3-731ecb36d227 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created volume successfully.
Feb 27 02:11:36 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9" returned: 0 in 0.525s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:36 devstack sudo[90670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9
Feb 27 02:11:36 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:36 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe 1073741824" returned: 0 in 0.535s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:36 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe
Feb 27 02:11:36 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:36 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-24656835-5753-407d-98a5-0393ff131be9" returned: 0 in 0.450s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-24656835-5753-407d-98a5-0393ff131be9" released by "delete_volume" :: held 1.011s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Created reservations ['da26bb4a-d05d-45fc-8faa-7248df9e8094', 'e256522c-0fc9-4408-83c8-6598b65b8045', '62e18b34-67e7-4679-816f-bfaa8b018e2b', '1fb61f22-0bd5-4541-903a-c4f2c0b378bc'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:36 devstack sudo[90677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:36 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:36 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe" returned: 0 in 0.410s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.018s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532949174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f771d1bc-8054-408b-a44b-95fb49ae2426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Creating volume f771d1bc-8054-408b-a44b-95fb49ae2426 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:36 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479ff59c-72e2-4ddb-a773-08231bc7ea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:36 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426 1073741824
Feb 27 02:11:36 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9fc43e-006f-43f1-a8ed-89508566c38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:36 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Volume volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe (94fb3527-bb35-4438-8fa8-6da0ef9c62fe): created successfully
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9fc43e-006f-43f1-a8ed-89508566c38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:36 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Flow 'volume_create_manager' (12e1c57f-f20b-4a05-97c5-27e92a235e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:36 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-9365911d-24d2-480d-a456-6d76ac7ae976 tempest-CinderUnicodeTest-2013799309 None] Created volume successfully.
Feb 27 02:11:37 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.415s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:37 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Deleted volume successfully.
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-343eefff-0a34-4914-b7a0-5688c306e4fe tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-24656835-5753-407d-98a5-0393ff131be9-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:37 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426 1073741824" returned: 0 in 0.502s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:37 devstack sudo[90685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426
Feb 27 02:11:37 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:37 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426" returned: 0 in 0.402s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.950s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1717380048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dce8ea-ff01-42b1-8680-8a5ef7830d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8ef700ea0c4ff3a1dc96cc1bffe6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:31Z,use_quota=True,user_id='17501c3309104a17b75f6fcb6e893b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Creating volume 57dce8ea-ff01-42b1-8680-8a5ef7830d5b {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:37 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5beb4e-adc0-4118-bf16-d94ee2cb1235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f771d1bc-8054-408b-a44b-95fb49ae2426', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1897c8d-3202-4c23-9023-aff177e83b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:37 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b 1073741824
Feb 27 02:11:37 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "cinder-aa6bb343-1f69-47e2-8b0c-d48e92f24408-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:37 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume volume-f771d1bc-8054-408b-a44b-95fb49ae2426 (f771d1bc-8054-408b-a44b-95fb49ae2426): created successfully
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1897c8d-3202-4c23-9023-aff177e83b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (e1771928-a1d8-4910-b79d-74df3b89fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-aa6bb343-1f69-47e2-8b0c-d48e92f24408-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:37 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-01f81d60-23d4-465b-9e44-f6112a2ae0fb tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created volume successfully.
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "cinder-quobyte-aa6bb343-1f69-47e2-8b0c-d48e92f24408" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-aa6bb343-1f69-47e2-8b0c-d48e92f24408" acquired by "delete_volume" :: waited 0.007s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45b02b3-93f2-41ff-9604-b4de15e2a549]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:37 devstack sudo[90690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408
Feb 27 02:11:37 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83140) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Feb 27 02:11:37 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Flow 'volume_create_manager' (a5b0ccc7-5048-4214-a2c6-6a66426a1a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c53d1e-bb1d-436f-9b5e-cb7a5d1e18f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c53d1e-bb1d-436f-9b5e-cb7a5d1e18f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-774713108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be855f7-3c75-47ec-851e-b992b4a316d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6580877eab964ad5b87b05693b001a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:38Z,use_quota=True,user_id='45512663ecc24825b8e4ad989d9ea25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe3716b-a3af-45f4-b5d1-d33d1deb0ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe3716b-a3af-45f4-b5d1-d33d1deb0ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14126890-7045-4ad4-8179-24cc0a4838e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14126890-7045-4ad4-8179-24cc0a4838e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be855f7-3c75-47ec-851e-b992b4a316d0', 'volume_name': 'volume-0be855f7-3c75-47ec-851e-b992b4a316d0', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c712dd-49d9-4577-bac1-820af4b4c0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c712dd-49d9-4577-bac1-820af4b4c0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9179ec9-b851-49b7-85db-0f4610c79178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:38 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Volume 0be855f7-3c75-47ec-851e-b992b4a316d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be855f7-3c75-47ec-851e-b992b4a316d0', 'volume_size': 1}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:38 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b 1073741824" returned: 0 in 0.561s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:38 devstack sudo[90695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b
Feb 27 02:11:38 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:38 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408" returned: 0 in 0.657s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:38 devstack sudo[90700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408
Feb 27 02:11:38 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:38 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b" returned: 0 in 0.478s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.466s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:38 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Cloning volume 2c47c33e-7994-4caa-b0b7-98a023c8032c to volume 5df79047-cc71-4f85-a599-eee9251dcf19
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a2b103-7f84-4a72-9f38-b79bde9304cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5d181f-fb89-498d-a3cd-eb1882e10e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:38 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Volume volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b (57dce8ea-ff01-42b1-8680-8a5ef7830d5b): created successfully
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5d181f-fb89-498d-a3cd-eb1882e10e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Flow 'volume_create_manager' (de65a610-2006-4cc5-931a-523e0df87020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Creating offline snapshot e341deed-da26-446f-8ee8-e42553655f46 of volume 2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:11:38 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-478aefe4-0116-4ef7-af9a-a3e32ab45e3a tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created volume successfully.
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[788f2818-261e-4e66-8684-52485e960e5a]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:38 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c
Feb 27 02:11:38 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:38 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-aa6bb343-1f69-47e2-8b0c-d48e92f24408" returned: 0 in 0.505s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-quobyte-aa6bb343-1f69-47e2-8b0c-d48e92f24408" released by "delete_volume" :: held 1.187s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:38 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Created reservations ['fe25ec76-20b6-470a-b53f-3b3280d9cb5b', 'f7171b12-024d-4436-91d4-49f4363f2237', 'd69dbdae-c72d-4352-8aac-dd3c0b8f7c28', '553e6a5a-2d2a-40c7-bccf-e50c7c9fdd09'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:39 devstack sudo[90707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:39 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-57dce8ea-ff01-42b1-8680-8a5ef7830d5b-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-57dce8ea-ff01-42b1-8680-8a5ef7830d5b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-quobyte-57dce8ea-ff01-42b1-8680-8a5ef7830d5b" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-57dce8ea-ff01-42b1-8680-8a5ef7830d5b" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[246314ad-2639-4a8e-b617-9c62a916bfd8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:39 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b
Feb 27 02:11:39 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:39 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c" returned: 0 in 0.604s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:39 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 1G
Feb 27 02:11:39 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:39 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.469s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:39 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Deleted volume successfully.
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-ea015cf0-ff0c-43f5-9b2e-9467ab24eac5 tempest-SnapshotDependencyTests-1696278284 None] Lock "cinder-aa6bb343-1f69-47e2-8b0c-d48e92f24408-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:39 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b" returned: 0 in 0.495s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:39 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b
Feb 27 02:11:39 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:39 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 1G" returned: 0 in 0.558s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:39 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c47c33e-7994-4caa-b0b7-98a023c8032c -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:39 devstack sudo[90725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c47c33e-7994-4caa-b0b7-98a023c8032c -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46
Feb 27 02:11:39 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:40 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-57dce8ea-ff01-42b1-8680-8a5ef7830d5b" returned: 0 in 0.486s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-57dce8ea-ff01-42b1-8680-8a5ef7830d5b" released by "delete_volume" :: held 1.007s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created reservations ['9bee40a9-1be8-4eef-bcfb-19e5e83f0993', '8ba78a1b-8eb2-4849-a7db-93c512be2896', 'a37689e2-c8ff-4538-a5b7-6461e9a3c1f5', 'cda833be-c41b-4e1a-97e1-9e3e3f83aed4'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:40 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:40 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:40 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c47c33e-7994-4caa-b0b7-98a023c8032c -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46" returned: 0 in 0.555s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:40 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 is being set with open permissions: ugo+rw
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:40 devstack sudo[90733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46
Feb 27 02:11:40 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:40 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.482s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:40 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Deleted volume successfully.
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-89f19092-1e0d-4eaf-b8ef-88cfc60f4d3d tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-57dce8ea-ff01-42b1-8680-8a5ef7830d5b-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:40 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46" returned: 0 in 0.428s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:40 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:40 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.info
Feb 27 02:11:40 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:41 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.info" returned: 0 in 0.449s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:41 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.info is being set with open permissions: ugo+rw
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:41 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.info
Feb 27 02:11:41 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-f771d1bc-8054-408b-a44b-95fb49ae2426-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-f771d1bc-8054-408b-a44b-95fb49ae2426-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-quobyte-f771d1bc-8054-408b-a44b-95fb49ae2426" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-f771d1bc-8054-408b-a44b-95fb49ae2426" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[60247bc0-e34b-4586-bfaa-03c268a8238d]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:41 devstack sudo[90783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426
Feb 27 02:11:41 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:41 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.info" returned: 0 in 0.524s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-5df79047-cc71-4f85-a599-eee9251dcf19" by "_copy_volume_from_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-5df79047-cc71-4f85-a599-eee9251dcf19" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] snapshot: e341deed-da26-446f-8ee8-e42553655f46, volume: 5df79047-cc71-4f85-a599-eee9251dcf19,  {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24e1d24-04f1-4fe5-a3a8-3b4c9ea3e940]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:41 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:42 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426" returned: 0 in 0.542s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:42 devstack sudo[90788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46
Feb 27 02:11:42 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:42 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426
Feb 27 02:11:42 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:42 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46" returned: 0 in 0.645s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c47c33e-7994-4caa-b0b7-98a023c8032c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] will copy from snapshot at /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Creating direct copy from snapshot {{(pid=83140) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dbbf7c-7205-470a-9f78-d8e2894998c8]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:42 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-f771d1bc-8054-408b-a44b-95fb49ae2426" returned: 0 in 0.587s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-f771d1bc-8054-408b-a44b-95fb49ae2426" released by "delete_volume" :: held 1.153s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created reservations ['6b60a5c4-dcc8-41f5-b531-ca3c0d365709', 'b9b3bc51-ada9-42bf-a214-a232e65e8de3', 'e4e23524-9e67-489d-bde3-a6cddf05df65', '98e18a82-00c2-4f8b-af61-0ee966ce153c'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:42 devstack sudo[90797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c
Feb 27 02:11:42 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:42 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:42 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:42 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:43 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c" returned: 0 in 0.620s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG cinder.utils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Path /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19 not found in is_blk_device check {{(pid=83140) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:43 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19
Feb 27 02:11:43 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:43 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.497s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:43 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Deleted volume successfully.
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7167fb0c-739e-451c-a3f5-56d3f25d3253 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-f771d1bc-8054-408b-a44b-95fb49ae2426-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-11bf286a-9946-4cd4-9d0f-2182ad8ef42f-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-11bf286a-9946-4cd4-9d0f-2182ad8ef42f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-quobyte-11bf286a-9946-4cd4-9d0f-2182ad8ef42f" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-11bf286a-9946-4cd4-9d0f-2182ad8ef42f" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[95732947-08c8-4706-8598-5339d5b4eff4]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:43 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:43 devstack sudo[90812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f
Feb 27 02:11:43 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:44 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f" returned: 0 in 1.057s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:44 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f
Feb 27 02:11:44 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:45 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19" returned: 0 in 2.350s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a294489-c321-4135-bc9a-416d9af73dd2]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:45 devstack sudo[90826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c
Feb 27 02:11:45 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:45 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-11bf286a-9946-4cd4-9d0f-2182ad8ef42f" returned: 0 in 0.938s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-11bf286a-9946-4cd4-9d0f-2182ad8ef42f" released by "delete_volume" :: held 2.026s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created reservations ['71629c5d-bf2a-487b-95a6-087672f44ae0', '4962d36e-80a9-4d02-b5e3-7c68477caed6', '087f567f-f2fa-4c9e-8650-52a833cbc4c8', 'eaa013e4-1465-48fe-bbec-57b44db6bf26'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:45 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:45 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:45 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-00895fa1-e296-43fd-acb4-9001c646f1f0-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-00895fa1-e296-43fd-acb4-9001c646f1f0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-quobyte-00895fa1-e296-43fd-acb4-9001c646f1f0" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-00895fa1-e296-43fd-acb4-9001c646f1f0" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b79fe4-d826-4450-8f22-e6e5312610a4]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:46 devstack sudo[90832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0
Feb 27 02:11:46 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:46 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c" returned: 0 in 0.779s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Image conversion details: src /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19 {{(pid=83140) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Feb 27 02:11:46 devstack cinder-volume[83140]: INFO cinder.image.image_utils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Converted 1024.00 MB image at 435.49 MB/s
Feb 27 02:11:46 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19 is being set with open permissions: ugo+rw
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:46 devstack sudo[90838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19
Feb 27 02:11:46 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:46 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.590s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:46 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Deleted volume successfully.
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-c4df9cf6-b578-43ab-a547-d171769bb193 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-11bf286a-9946-4cd4-9d0f-2182ad8ef42f-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:46 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0" returned: 0 in 0.560s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:46 devstack sudo[90843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0
Feb 27 02:11:46 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:46 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19" returned: 0 in 0.478s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-5df79047-cc71-4f85-a599-eee9251dcf19" released by "_copy_volume_from_snapshot" :: held 4.928s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-e341deed-da26-446f-8ee8-e42553655f46" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-e341deed-da26-446f-8ee8-e42553655f46" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Deleting offline snapshot e341deed-da26-446f-8ee8-e42553655f46 of volume 2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] snapshot_file for this snap is: volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[d731f931-63c9-41f7-bb84-ca216a16775f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:47 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46
Feb 27 02:11:47 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:47 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-00895fa1-e296-43fd-acb4-9001c646f1f0" returned: 0 in 0.557s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-00895fa1-e296-43fd-acb4-9001c646f1f0" released by "delete_volume" :: held 1.156s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created reservations ['bbe25186-da11-4223-9d5a-8379b9b69a55', '65a0619b-f6b0-4c72-bb58-b20490d5e690', 'b25d415c-bc59-4f9f-96f2-c53e527e3edb', 'fc15ce4a-09fd-4518-b4ce-d0c2c52934da'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:47 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:47 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:47 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46" returned: 0 in 0.646s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c47c33e-7994-4caa-b0b7-98a023c8032c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8251ea2d-0420-4730-b6a5-13cfce919bbb]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:47 devstack sudo[90855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c
Feb 27 02:11:47 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:47 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.533s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:47 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Deleted volume successfully.
Feb 27 02:11:47 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-8b3fc3ad-61d7-4572-b9da-696f126276ff tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-00895fa1-e296-43fd-acb4-9001c646f1f0-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:48 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c" returned: 0 in 0.683s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:48 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46
Feb 27 02:11:48 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-quobyte-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e" acquired by "delete_volume" :: waited 0.011s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a701f71-7b4a-4790-ac26-b67b2e6be127]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:48 devstack sudo[90864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e
Feb 27 02:11:48 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:48 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46" returned: 0 in 0.616s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:48 devstack sudo[90872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46
Feb 27 02:11:48 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:48 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e" returned: 0 in 0.646s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:48 devstack sudo[90874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e
Feb 27 02:11:48 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:49 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e" returned: 0 in 0.446s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e" released by "delete_volume" :: held 1.118s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:49 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c.e341deed-da26-446f-8ee8-e42553655f46" returned: 0 in 0.561s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-e341deed-da26-446f-8ee8-e42553655f46" released by "_delete_snapshot" :: held 2.559s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.788s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.443s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7592823070>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-02-27T01:11:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-774713108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be855f7-3c75-47ec-851e-b992b4a316d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6580877eab964ad5b87b05693b001a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:38Z,use_quota=True,user_id='45512663ecc24825b8e4ad989d9ea25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da7518a-d695-45b7-8cf5-2669cf910a10),volume_type_id=1da7518a-d695-45b7-8cf5-2669cf910a10)}" {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Creating volume 0be855f7-3c75-47ec-851e-b992b4a316d0 {{(pid=83140) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Selected osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad as target Quobyte volume. {{(pid=83140) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Feb 27 02:11:49 devstack cinder-volume[83140]: INFO cinder.volume.drivers.remotefs [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] casted to osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0 1073741824 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941107d0-159e-4647-9365-977e7a79d5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df79047-cc71-4f85-a599-eee9251dcf19', 'volume_size': 1, 'source_volid': '2c47c33e-7994-4caa-b0b7-98a023c8032c', 'source_volstatus': 'available'}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:49 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0 1073741824
Feb 27 02:11:49 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc83978-d3c1-4a4a-9e86-cffd92a4ed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:49 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Volume volume-5df79047-cc71-4f85-a599-eee9251dcf19 (5df79047-cc71-4f85-a599-eee9251dcf19): created successfully
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc83978-d3c1-4a4a-9e86-cffd92a4ed3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Flow 'volume_create_manager' (c6dfb794-145e-417e-a5b9-a6fe22fe3539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created reservations ['4d366d0d-baf4-4647-b0dc-510f7d86fb9d', 'e70dcd8b-f51d-496f-9701-216913eceb3d', 'bbae873f-acbb-4bb3-8a57-74b6c6b374dd', '5e06f4d9-43ae-4c6b-af81-439d5cc05e8e'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:49 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-5ee92eb2-028a-4b80-9569-57470558e3e4 tempest-VolumeDependencyTests-361767958 None] Created volume successfully.
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:49 devstack sudo[90880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:49 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:50 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0 1073741824" returned: 0 in 0.556s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:50 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0
Feb 27 02:11:50 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:50 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.511s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:50 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Deleted volume successfully.
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-40c6df0d-32b8-4461-b0a8-d2920c6f0393 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-9b8b235c-ef8c-49bb-b61c-02f64fc4ae8e-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-2c47c33e-7994-4caa-b0b7-98a023c8032c-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-2c47c33e-7994-4caa-b0b7-98a023c8032c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-2c47c33e-7994-4caa-b0b7-98a023c8032c" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-2c47c33e-7994-4caa-b0b7-98a023c8032c" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[2712fb32-398a-4c99-b9a4-4fcc402ab9fd]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-a05ee5c4-500c-448b-8101-e06377bd2164-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-a05ee5c4-500c-448b-8101-e06377bd2164-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-quobyte-9548d495-af3e-4265-94f4-b4fd15e3d369" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-9548d495-af3e-4265-94f4-b4fd15e3d369" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-quobyte-a05ee5c4-500c-448b-8101-e06377bd2164" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:50 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c
Feb 27 02:11:50 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-a05ee5c4-500c-448b-8101-e06377bd2164" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Deleting offline snapshot a05ee5c4-500c-448b-8101-e06377bd2164 of volume 9548d495-af3e-4265-94f4-b4fd15e3d369 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] snapshot_file for this snap is: volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a89e567-1ee7-4f07-a6a4-eb080407b218]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:50 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0" returned: 0 in 0.461s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'} {{(pid=83140) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9179ec9-b851-49b7-85db-0f4610c79178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be855f7-3c75-47ec-851e-b992b4a316d0', 'volume_size': 1}' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:50 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164
Feb 27 02:11:50 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df212bd-3aa3-4f46-8c16-df1b5827eee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Feb 27 02:11:50 devstack cinder-volume[83140]: INFO cinder.volume.flows.manager.create_volume [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Volume volume-0be855f7-3c75-47ec-851e-b992b4a316d0 (0be855f7-3c75-47ec-851e-b992b4a316d0): created successfully
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df212bd-3aa3-4f46-8c16-df1b5827eee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83140) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Flow 'volume_create_manager' (a5b0ccc7-5048-4214-a2c6-6a66426a1a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83140) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Feb 27 02:11:50 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7f58acd5-cc41-409f-80ea-f0442cb52029 tempest-CinderUnicodeTest-2013799309 None] Created volume successfully.
Feb 27 02:11:50 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c" returned: 0 in 0.597s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:50 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c
Feb 27 02:11:50 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:51 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164" returned: 0 in 0.523s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9548d495-af3e-4265-94f4-b4fd15e3d369(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff33879-e2bd-4ec6-b710-80514aa65c61]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Creating offline snapshot 254d3cda-2313-47cc-afed-08f1ae2f5ed4 of volume 0be855f7-3c75-47ec-851e-b992b4a316d0 {{(pid=83140) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[569118d9-25aa-4d9f-a74c-a203c436af4c]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:51 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369
Feb 27 02:11:51 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:51 devstack sudo[90902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0
Feb 27 02:11:51 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:51 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2c47c33e-7994-4caa-b0b7-98a023c8032c" returned: 0 in 0.478s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-2c47c33e-7994-4caa-b0b7-98a023c8032c" released by "delete_volume" :: held 1.107s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Created reservations ['867986e1-35eb-4850-be0d-1eba622ab5a6', 'ddb9940c-6c70-4536-a6e1-b26aca761cf5', '15981ac6-3b9b-45da-b28a-508323f0f33e', '0cf27419-c376-4465-8784-aa3335cafc0a'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:51 devstack sudo[90910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:51 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:51 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0" returned: 0 in 0.511s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 1G {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:51 devstack sudo[90914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 1G
Feb 27 02:11:51 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:51 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369" returned: 0 in 0.627s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:51 devstack sudo[90916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164
Feb 27 02:11:51 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:51 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.450s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:51 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Deleted volume successfully.
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7457ec9d-5ee9-439f-93a6-1bb66efcb578 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-2c47c33e-7994-4caa-b0b7-98a023c8032c-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:52 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164" returned: 0 in 0.487s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:52 devstack sudo[90925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164
Feb 27 02:11:52 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:52 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 1G" returned: 0 in 0.618s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0be855f7-3c75-47ec-851e-b992b4a316d0 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:52 devstack sudo[90927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0be855f7-3c75-47ec-851e-b992b4a316d0 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4
Feb 27 02:11:52 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:52 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369.a05ee5c4-500c-448b-8101-e06377bd2164" returned: 0 in 0.478s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-5df79047-cc71-4f85-a599-eee9251dcf19-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-a05ee5c4-500c-448b-8101-e06377bd2164" released by "_delete_snapshot" :: held 2.197s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-5df79047-cc71-4f85-a599-eee9251dcf19-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-9548d495-af3e-4265-94f4-b4fd15e3d369" released by "delete_snapshot" :: held 2.223s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-5df79047-cc71-4f85-a599-eee9251dcf19" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:52 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0be855f7-3c75-47ec-851e-b992b4a316d0 -F qcow2 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4" returned: 0 in 0.501s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:52 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 is being set with open permissions: ugo+rw
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-5df79047-cc71-4f85-a599-eee9251dcf19" acquired by "delete_volume" :: waited 0.026s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created reservations ['7086db31-45a2-4558-8faf-77a03fb760ed', '0540244c-f525-483b-b24b-ec796ddc8f79', '221893a4-006c-4b39-a2ae-a0ed585afe6e', '178531ca-fa72-4b8e-8480-8b7c01cb3d94'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:52 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4
Feb 27 02:11:52 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b43c71-6372-423d-acab-39c149947078]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:52 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Delete snapshot completed successfully.
Feb 27 02:11:52 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-01730e21-5e1a-4be5-be56-4556b4930392 tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-a05ee5c4-500c-448b-8101-e06377bd2164-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:52 devstack sudo[90935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19
Feb 27 02:11:52 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:53 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4" returned: 0 in 0.452s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:53 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.info
Feb 27 02:11:53 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:53 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19" returned: 0 in 0.554s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:53 devstack sudo[90944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19
Feb 27 02:11:53 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-9548d495-af3e-4265-94f4-b4fd15e3d369-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-9548d495-af3e-4265-94f4-b4fd15e3d369-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:53 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "cinder-quobyte-9548d495-af3e-4265-94f4-b4fd15e3d369" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.info" returned: 0 in 0.435s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:53 devstack cinder-volume[83140]: WARNING cinder.volume.drivers.remotefs [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.info is being set with open permissions: ugo+rw
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.info {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-9548d495-af3e-4265-94f4-b4fd15e3d369" acquired by "delete_volume" :: waited 0.021s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:53 devstack sudo[90947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.info
Feb 27 02:11:53 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7031abd-96ea-4a57-bc40-bec5dc15c6cb]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:53 devstack sudo[90949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369
Feb 27 02:11:53 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:53 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-5df79047-cc71-4f85-a599-eee9251dcf19" returned: 0 in 0.518s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-5df79047-cc71-4f85-a599-eee9251dcf19" released by "delete_volume" :: held 1.098s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Created reservations ['47f176b5-9d82-4562-aad5-8d51ecbbdb46', 'b81211ef-943c-4996-b416-02c055d0de90', '8f083ce5-0c90-4913-8590-a6956c2bb4f4', '921c0cd5-68f7-47c0-8815-0935df7480bf'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:53 devstack sudo[90952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:53 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:54 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.info" returned: 0 in 0.456s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:54 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-18b86d47-817e-4c28-a536-02ab83b5798b tempest-CinderUnicodeTest-2013799309 None] Create snapshot completed successfully
Feb 27 02:11:54 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369" returned: 0 in 0.517s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:54 devstack sudo[90958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369
Feb 27 02:11:54 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:54 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.470s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:54 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Deleted volume successfully.
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-26fd1bb4-b6ca-4b0e-bfe6-f435b229e648 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-5df79047-cc71-4f85-a599-eee9251dcf19-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:54 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-9548d495-af3e-4265-94f4-b4fd15e3d369" returned: 0 in 0.441s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-quobyte-9548d495-af3e-4265-94f4-b4fd15e3d369" released by "delete_volume" :: held 0.989s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Created reservations ['157aac7e-b4c7-4335-b043-08b8e79dcb52', '9ef45370-c313-41b9-8215-25927a8908de', '387bd499-2083-402b-a6e9-74295ca4d807', '7abd09fc-f57c-4642-ac71-cdfb22ff1886'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:54 devstack sudo[90962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:54 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-2be0176d-d61a-4435-a130-8ba40b25f082-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-2be0176d-d61a-4435-a130-8ba40b25f082-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "cinder-quobyte-2be0176d-d61a-4435-a130-8ba40b25f082" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-2be0176d-d61a-4435-a130-8ba40b25f082" acquired by "delete_volume" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[f122d8f3-0332-4687-abb5-287ab2088647]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:54 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:55 devstack sudo[90964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082
Feb 27 02:11:55 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:55 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.481s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:55 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Deleted volume successfully.
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-4234a224-d6ca-434f-86f1-34db0f48cada tempest-CreateVolumesFromSnapshotTest-1252565738 None] Lock "cinder-9548d495-af3e-4265-94f4-b4fd15e3d369-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "cinder-254d3cda-2313-47cc-afed-08f1ae2f5ed4-delete_snapshot" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-254d3cda-2313-47cc-afed-08f1ae2f5ed4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "cinder-quobyte-0be855f7-3c75-47ec-851e-b992b4a316d0" by "delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-quobyte-0be855f7-3c75-47ec-851e-b992b4a316d0" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "cinder-quobyte-254d3cda-2313-47cc-afed-08f1ae2f5ed4" by "_delete_snapshot" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-quobyte-254d3cda-2313-47cc-afed-08f1ae2f5ed4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Deleting offline snapshot 254d3cda-2313-47cc-afed-08f1ae2f5ed4 of volume 0be855f7-3c75-47ec-851e-b992b4a316d0 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] snapshot_file for this snap is: volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 {{(pid=83140) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a38d48-3c46-41af-ab18-0ad4d765269f]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:55 devstack sudo[90967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4
Feb 27 02:11:55 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:55 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082" returned: 0 in 0.573s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:55 devstack sudo[90972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082
Feb 27 02:11:55 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:55 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4" returned: 0 in 0.589s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.remotefs [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0be855f7-3c75-47ec-851e-b992b4a316d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83140) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acf1de7-45ce-4937-89d1-b3c0fceed0f3]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:55 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:56 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-2be0176d-d61a-4435-a130-8ba40b25f082" returned: 0 in 0.553s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:56 devstack sudo[90978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0
Feb 27 02:11:56 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-quobyte-2be0176d-d61a-4435-a130-8ba40b25f082" released by "delete_volume" :: held 1.153s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Created reservations ['16b9b116-d9b7-4eba-907e-486b7f0edf5c', '7ccc2d4a-0149-460c-8769-c2969c7bda8f', '1d7cff08-5eb1-4418-a60b-9a28057ac321', '794d9e6e-801f-46de-85ca-bc0003154e48'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:56 devstack sudo[90980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:56 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:56 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0" returned: 0 in 0.699s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:56 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4
Feb 27 02:11:56 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:56 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.541s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:56 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Deleted volume successfully.
Feb 27 02:11:56 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-919d733a-097b-46ce-941b-b87aeb555c84 tempest-VolumeDependencyTests-361767958 None] Lock "cinder-2be0176d-d61a-4435-a130-8ba40b25f082-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:57 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4" returned: 0 in 0.648s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:57 devstack sudo[90992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4
Feb 27 02:11:57 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:57 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:57 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0.254d3cda-2313-47cc-afed-08f1ae2f5ed4" returned: 0 in 0.487s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-quobyte-254d3cda-2313-47cc-afed-08f1ae2f5ed4" released by "_delete_snapshot" :: held 2.507s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-quobyte-0be855f7-3c75-47ec-851e-b992b4a316d0" released by "delete_snapshot" :: held 2.523s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:57 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Created reservations ['66a6c156-5520-429d-adfe-6d52b47d340a', '4bf3e02e-b416-4517-bdc0-512b7ff08a72', 'cf7007a8-ed35-4511-84b9-411ddf0d8f9f', '4b373e12-7106-406f-ae48-5fc1ed5e2157'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:57 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Delete snapshot completed successfully.
Feb 27 02:11:57 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-7c9cf845-6768-41e6-86f7-12636b096fd5 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-254d3cda-2313-47cc-afed-08f1ae2f5ed4-delete_snapshot" released by "delete_snapshot" :: held 2.642s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "cinder-0be855f7-3c75-47ec-851e-b992b4a316d0-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-0be855f7-3c75-47ec-851e-b992b4a316d0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "cinder-quobyte-0be855f7-3c75-47ec-851e-b992b4a316d0" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:58 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-quobyte-0be855f7-3c75-47ec-851e-b992b4a316d0" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:58 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd72aadf-b908-4439-8167-36950a462659]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:58 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:58 devstack sudo[90997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0
Feb 27 02:11:58 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:59 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0" returned: 0 in 0.489s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:59 devstack sudo[91002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0
Feb 27 02:11:59 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:59 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-0be855f7-3c75-47ec-851e-b992b4a316d0" returned: 0 in 0.411s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-quobyte-0be855f7-3c75-47ec-851e-b992b4a316d0" released by "delete_volume" :: held 0.933s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Created reservations ['1f3d355a-c706-4231-8cc3-d9b952425af9', '816c30ab-7dda-4ac3-bf3f-39dbde814418', 'aea1c560-4407-4cad-94d3-abf25fc8eaee', '9a08114f-2751-445d-b74c-8c2a54961a83'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:59 devstack sudo[91005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:11:59 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "cinder-94fb3527-bb35-4438-8fa8-6da0ef9c62fe-delete_volume" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-94fb3527-bb35-4438-8fa8-6da0ef9c62fe-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "cinder-quobyte-94fb3527-bb35-4438-8fa8-6da0ef9c62fe" by "delete_volume" {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-quobyte-94fb3527-bb35-4438-8fa8-6da0ef9c62fe" acquired by "delete_volume" :: waited 0.009s {{(pid=83140) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c475651-cf0c-4230-916c-aab2591e7746]: (4, 'qcow2') {{(pid=83843) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:11:59 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe
Feb 27 02:11:59 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:11:59 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.436s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:11:59 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Deleted volume successfully.
Feb 27 02:11:59 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-948d30da-4a51-458e-b143-eb46d8342197 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-0be855f7-3c75-47ec-851e-b992b4a316d0-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:12:00 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe" returned: 0 in 0.496s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:12:00 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe
Feb 27 02:12:00 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:12:00 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1/volume-94fb3527-bb35-4438-8fa8-6da0ef9c62fe" returned: 0 in 0.400s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-quobyte-94fb3527-bb35-4438-8fa8-6da0ef9c62fe" released by "delete_volume" :: held 0.920s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG cinder.quota [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Created reservations ['77c0d766-a7f4-4161-bccb-804490ecc673', '06c0ccbd-d3d3-4b65-a949-667e6bd7b0a4', '2210f8c1-d486-4e32-b455-d66c633e4fb6', '5d5ea9f3-f279-4f89-a634-e50104322e2b'] {{(pid=83140) reserve /opt/stack/cinder/cinder/quota.py:752}}
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad': None} {{(pid=83140) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.quobyte [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e37b1345-d35b-41eb-8d79-5789fe9286ad'] {{(pid=83140) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83140) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Feb 27 02:12:00 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Feb 27 02:12:00 devstack sudo[91016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1
Feb 27 02:12:00 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Feb 27 02:12:01 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root
Feb 27 02:12:01 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/243c95e94e24ab382935eb57f29fa6a1" returned: 0 in 0.485s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Feb 27 02:12:01 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Feb 27 02:12:01 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Deleted volume successfully.
Feb 27 02:12:01 devstack cinder-volume[83140]: DEBUG cinder.coordination [None req-82a53aa5-9458-4132-b792-a1d91508ac71 tempest-CinderUnicodeTest-2013799309 None] Lock "cinder-94fb3527-bb35-4438-8fa8-6da0ef9c62fe-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83140) __release /opt/stack/cinder/cinder/coordination.py:152}}
Feb 27 02:12:10 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=103,cinder:UPDATE=150,cinder:INSERT=40,cinder:DELETE=6 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Feb 27 02:12:11 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=110,cinder:INSERT=39,cinder:UPDATE=155,cinder:DELETE=20 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}